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The National Association for Research in Science Teaching sponsored 
a three-day research training program in Chicago , November 11-14, 1969. 
Supported by a grant from the U. S. Office of Education, the program was 
designed to improve the research competence of individuals involved 
with the training of future researchers. Fifty two participants received 
training during the three-day program, the first of its kind with U.S.O.E. 
support. . 

Training sessions were of two kinds. Work Sessions were led by 
leaders in specific research areas-, and these constituted the primary 
training effort with specific research skills taught during these sessions. 
Problem Sessions were led by senior participants for the purpcse of ex- 
amining ways in which skills Laight in Work Sessions could be applied 
to specific research problems in science education. 

Participants were primarily college and 'university professors in- 
volved in training future research workers. Evaluation by the session 
leaders and the participants indicated that the program was successful 
in imparting new research competencies and suggesting promising areas 
for future research. The unanimous conclusion was that similar training 
programs should be held in the future, with some modifications indicated 
in the evaluation material. 



THE NARST RESEARCH TRAINING PROGRAM 
IN SCIENCE EDUCATION 

Program Overview 

For over forty years the National Association for Research in Science 
Teaching has conducted a number of activities toward the end of improving 
research in science education. Most of the research published relative to the 
teaching of science in the past forty years has been work done or supervised by 
members of NARST. The quality of this research has been spotty, although there 
are clear indications that better research techniques and methods have been em- 
ployed in more recent years. Nevertheless, it is equally evident that there has 
been substantial need for improvement in the general level of the science edu- 
cation research efforts. It was to this end that NARST sought support from the 

U. S. Office of Education for the conduct of a research training program. 

A preliminary program was assembled by the Project Director with counsel 
from various board members of NARST and other individuals. A copy of the pre- 
liminary program is included in Appendix A-l. It was planned that a meeting of 
several leadership personnel to be involved in the training program would take 
place prior to the training sessions in order to coordinate and refine plans for 
the sessions* This meeting was held in Chicago on September 26, 1969. It was 
decided at this meeting that two kinds of sessions should be held. The first 
sessions, called Work Sessions, were to be the primary vehicle for training par- 
ticipants in specific research skills. These sessions were to be led by indi- 
viduals with established reputation in their specific areas of competence. All 

participants in the training program were to select one series of Work Sessions 

and to cont in ue with these Work Sessions through the three day training program. 
A second series of sessions, called Problem Sessions, was designed to focus on 
specific problems in science education to which the research skills presented in 
the Work Sessions could be applied. The Problem Session also was to serve as 
an opportunity for more informal discussion among trainees. A final program was 
prepared and this is shown in Appendix A-2. 

In order to provide all participants with some introduction to the research 
competencies to be developed in each of the Work Sessions , brief descriptions of 
each of the six Work Sessions were presented by the session leaders during the 
first day of the training program. Dr. Henry Walbesser, University of Maryland, 
presented some of his views on the improvement of science research specifically 
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referring to the need for clear specification of objectives in research. He in- 
dicated that his training sessions would provide practice with some techniques 
and skills needed in science education research. Dean J. Myron Atkin, University 
of Illinois, took a position somewhat different from the other Work Session leaders 
and described some issues in determining research priorities that influence policy 
decisions in education. Dean Atkin's presentation on Wednesday and a longer pre- 
sentation to the entire group on Thursday morning raised issues regarding the nar- 
row definition of research in education and the application of this kind of re- 
search to policy decisions in curriculum design and support of educational inves- 
tigation. Dr. Wayne Welch, University of Minnesota, introduced a number of issues 
involved in the evaluation of curriculum. Drawing on his experience from Harvard 
Project Physics and from other curriculum evaluation programs. Dr. Welch led sesr 
8 ions focusing on research methodology appropriate to curriculum evaluation. 

Dr. John A. Easley, University of Illinois, used video tape to illustrate how con- 
ceptual analysis of classroom and clinical interview behavior could be conducted. 

His sessions Included the viewing of video tapes and the development of skills In- 
volved In clinical research with children In classroom settings. Dr. Duncan Hansen, 
Florida State Universitv. provided 9 a ie»-t > a: 
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A brief summary session was held on Friday afternoon. The intent was less 
to summarize the training sessions than to provide an opportunity for group feed- 
back which might be useful in the planning of future training programs. Following 
the training sessions, a questionnaire form was mailed to all participants and 
their responses are reported below. 

Participants in the Research Training Program 

A program announcement was prepared and mailed to all members of the National 
Association for Research in Science Teaching. Announcements of the research 
training program were also sent to the following journals: The Science Teacher , 

Science and Children , The Journal of Chemical Education , and The American Biology 
Tercher . It was evident from the kind of applications received that these an- 
nouncements succeeded in attracting a significant number of applicants. A copy 
of the program announcement and application form appears in Appendix A-l. 

In spite of a relatively tight time schedule, over 350 completed application 
forms were returned. All but three of these applications came from individuals 
who reported no prior attendance at a research training program sponsored by the 
American Educational Research Association. It is evident that we reached a popu- 
lation of research workers with this program that has been largelv untouched by 
the research training efforts of AERA. Many of the applicants were classroom 
teachers at the elementary and secondary level. Since the primary objective of 
the research training program was the training of individuals actively involved 
in the supervision and training of research workers, very few of the participants 
came from public schools. A list of the participants is included in Appendix B-l. 
A summary of the data on the application form is given in Appendix B-2. This 
data summary shows that the average age of the participants was 41. All but two 
held the Ph.D. or Ed.D. degree. Most of the participants were from universities 
and 27 states were represented. The participants published an average of 15 
research articles or technical reports. They are active in other professional 
organizations as indicated in their response to item 16. 

It was evident in reading the reasons why many of the participants indicated 
a desire to attend a research training program that the interpretation of what 
constitutes research in science education varies enormously. Some participants 
indicated that they wished to attend to learn how research in science teaching 
could make them a better classroom teacher of biology or chemistry or some other 
subject. Some indicated a desire to acquire specific competencies normally pre- 
sented in graduate training programs for research workers, for example, to learn 
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more about statistical tools and their applic n to research in science edu- 
cation. While these goals may be laudable, it was doubtful that any of them 
could be met in a three day research training program. There was a close corre- 
lation between the objectives stated by those individuals selected for program 
participation and the research competencies we sought to develop in the training 
programs . 

All participants selected attended the training sessions. In addition to 
100% attendance, we found the participants to be almost without exception enthusi- 
astic and active throughout the program. Their willingness to take three days 
from busy work schedules to attend sessions to improve their research competence 
is evidence that the program was needed and that similar training programs are 
likely to receive enthusiastic and productive response. 

The Training Program Work Sessions 

All participants were asked to select one of six Work Sessions prior to 
their arrival in Chicago. Materials prepared by the Work Session leaders were 
mailed to the participants in advance of the sessions. These materials appear 
in Appendix C-l. Reprints of research studies, mimeographed materials, and 
other special handouts were also distributed during the Work Sessions. The large 
bulk of these materials preclude inclusion in this report. However, a listing 
of jnany of the references used is given in Appendix C-2. In addition to material 
distributed, the large fund of experience in research brought to the training 
sessions by the Work Session leaders and by many of the participants contributed 
substantially to the work of the sessions. 

The Work Session led by Professor Henry Walbesser of the University, of Mary- 
land used material developed by Professor Walbesser and selected research studies 
in the training of participants in specific research competencies. The Work 
Session dealt with the acquisition of a specified collection of twenty-three 
behaviors. Instructional materials were developed for each of the behaviors and 
assessment tasks, different from the instructional activities, were also con- 
structed. The participants in this work group acquired the first 18 of the be- 
haviors. There was not sufficient time to progress through the remaining five 
behaviors. The participants did acquire the specified research competencies as 
measured by the assessment tasks. Whether these were acquired in any broader 
context will need the passage of time and examination of research publications 
from the work group participants and the publications of the participants’ 
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The Work Sessions led by Professor J. Myron Atkin of the University of 
Illinois departed from the pattern for other sessions and dealt with a number 
of issues involved in policy decisions in the establishment of research priorities 
and allocation of effort in other areas of education. This group used as a spring- 
board for discussion a paper prepared by Professor Atkin, "Research Styles in 
Science Education," published in the Journal of Research in Science Teachin g at 
an earlier date. Professor Atkin also presented a seminar on some of his ideas 
on Thursday morning. The latter seminar was attended by all participants in the 
training conference. A major argument of Professor Atkin is that the "systems 
approach to education, or the application of engineering models to education, is 
inappropriate and can lead to unpredictable and unfortunate consequences. Research 
styles in education too often follow the pattern in the physical sciences with the 
evident but unstated assumption that this research methodology is appropriate 
to education and that instructional design can be approached in a quasi-systems 
manner. These Work Sessions and the subsequent involvement of the participants in 
Problem Sessions served as a stimulus for critical review of the application of 
research competencies provided to trainees in other Work Sessions. 

The Work Sessions on curriculum evaluation strategies led by Professor Wayne 
Welch of the University of Minnesota utilized a number of published research re- 
ports, given in Appendix C-2 as well as other materials distributed at the ses- 
sions. Trainees were instructed in techniques for formative and summative evalu- 
ation. The formative evaluation program of the Ginn and Company Elementary Science 
course was used as one example of curriculum evaluation. The four year evaluation 
program for Harvard Project Physics was a primary reference source. Also used 
was the summative evaluation of the course. Physical Science for Non-Scientists 
(PSNS) . In addition to critical review of the materials, participants were asked 
to criticize and evaluate selected aspects of the curriculum evaluation studies. 

The latter work indicated substantial progress in the group in their curriculum 

evaluation skills. 

Utilizing portable video tape recordings. Professor John A. Easley of the 
University of Illinois led his Work Sessions in the clinical analysis of teacher 
and pupil behaviors in classrooms. Drawing from materials distributed to parti- 
cipants in advance, the trainees analyzed the behavior of teachers and pupils in 
the taped classroom behavior samples. These sessions provided an opportunity to 
acquire skills in the use of clinical observation techniques through their appli- 
cation in a sample of recorded sessions. 

The sessions on the use of computers in science education research were led 
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by Professor Duncan Hansen of the Florida State University. Each of the parti- 
cipants in this session focused on a problem related to the development of a new 
instructional subsystem utilizing a computer. Some of the participants related 
directly to research projects in which they are engaged or to new research topics 
which they considered feasible for their particular circumstance. Each of the 
participants gained sufficient understanding of the essential concepts involved 
in the psychology, direction, presentation, correction, and evaluation of materials 
in order to provide clarity to the case study project utilized in the training 
session. Each participant developed a research design in some cases hypothetical, 
that would provide an opportunity to assess rigorously the nature and mer'*t of 
their proposed science instructional component utilizing computers. The parti- 
cipants reacted to the research literature review and established lines of com- 
munication for future exchange of ideas on the use of computers in their research. 

The Work Sessions led by Professor Novak of Cornell University focused on 
the learning theory of Professor David Ausubel. Reviewing some of the major con- 
structs of this theory, as presented in his book, Educational Psychology: A 
Cognitive View , the group proceeded to review selected research studies to deter- 
mine what interpretation could be placed on the data if the learning theoretical 
model of Professor Ausubel were applied. Since most reported research in science 
education does not relate to any learning theoretical base, it is possible 9 
though hazardous, to reinterpret data obtained in research and to test hypotheses 
that would derive from the learning theory through post-hoc interpretation of 
published data. The participants succeeded in acquiring the necessary knowledge 
and skill needed to reinterpret earlier studies and to assess their support or 
non-support of Ausubelian learning theory. The second and third Work Sessions 
focused on the design of new research studies that would be based on Ausubelian 
theory and contribute evidence relative to specific constructs in the theory. 

It was agreed that this type of focus in science education research studies could 
increase the generalizability of research findings and enhance their potential 
application to the design of science instruction. 

It was the impression of the Work Session leaders , in a summary conference 
on Friday morning, that the trainees were highly cooperative and seriously in- 
volved in the sessions. This active participation by the trainees contributed 
substantially to the value of all the Work Sessions. Many of the individuals 
involved in the Work Sessions have had substantial experience in science education 
and brought this experience to bear on the development of the specific research 
competencies or on the issues of science education discussed in the Work Sessions. 

o 
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Training Program Problem Sessions 



The purpose of the Problem Sessions was to Provide a different mixing of 
participants from various Work Sessions where research skills obtained in the 
Work Sessions could be applied to specific problems in science education. Most 
of the Work Sessions operated quite formally with training procedures following 
almost a classroom routine. It was thought that the Problem Sessions thus would 
contribute some variety of pacing to the total training program. A nunfeer of 
problem areas were identified and participants were asked to indicate which ses- 
sions were of particular interest to them. They were also asked to suggest other 
problem areas which they would lixe to explore. A list of Problem Session parti- 
cipants and tne chairmen for the Problem Session groups is given in Appendix D-l. 

Nine Problem Session groups were formed, eached chaired by a participant 
selected for this role in advance of the meetings. In most cases, the chairmen 
were senior members of the science education community who have had experience 
in the area of the Problem Session. The intent was to provide a forum for dis- 
cussion and analysis and not a series of lectures by individuals in the Problem 



Session groups. For the most part, our directive that the participants seek ways 
to apply skills they were obtaining in the Work Seejions to the topic of their 
Problem Session were followed. However, most trainees found it difficult to 
malfP specific, positive transfer from the Work Sessions to the Problem Sessions. 

Problem Session A dealt with the design of research training programs. This 
group, chaired by Professor Fletcher Watson of Harvard University, identified 
three types of research studies and terminal competencies needed for these types 
of research. The intent was to provide some general framework for the the design 
of research training programs. The types of research and terminal behaviors 

suggested were as follows: 



1 . 



Fields 

Hypothesis Testing 



2. Evaluative Studies 



3. Conceptual Analysis 



Terminal Behaviors 

To construct research 
hypotheses, investigations 

To construct research 
question investigations for 
summative , formative aid 
supportive studies 

To construct analyses of 
assumptions and alternative 
decision-making strategies 



It is interesting to note that most of the terminal behaviors suggested were 
a portion of the training objectives in at least one of the Work Sessions. While 
the needs of individuals from a wide variety of institutions varied enormously. 



o 
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there seemed to be some consensus that the Problem Session discussions and 
explorations were helpful to the individuals in the local planning efforts they 
hope to make in d3si<»ning research training programs. 

The second Problem Session dealt with research and methodology involving 
audio-tutorial methods. Professor Samuel Postlethwait of Purdue University chaired 
some of the sessions for this group. Other sessions were chaired by other members 
of the ^roup. The group discussed various forms of individualized instruction 
where . \ -tutorial methods could contribute substantially. It was also agreed 

that the combination of audio- tutorial methods with other forms of individual 
activity and with computer assisted instruction could be fruitful. Several areas 
of research were identified. It was indicated that comparative studies of conven- 
tional versus audio- tutorial programs could contribute little of value. More 
importantly, questions regarding the process by which students arrive at specific 
competencies u*.der the audio-tutorial regime were looked upon as more fruitful. 

Also needed, more research where learning theory is applied to the design of in- 
struction and data on pupil attainment is taken as e.nirical corroboration of the 
theoretical premises. The need for comparing relative student achievement under 
various alternative instructional sequences in the audio-tutorial format was also 
identified. In the latter regard, the efficiency of pupil learning under various 
instructional sequences as measured by the amount of time required to reach spe- 
cific competency levels was an important kind of research study needed. 

Two of the initial Problem Sessions were combined to form one group dealing 
with issues involved in communicating and writing research. This group was co- 
chaired by Professor Stanley Helgeson of Ohio State University and Professor 
Herbert Smith of Colorado State University. The group identified a number of 
issues and problems in communicating and writing research. These were summarized 
by the group in the following way: 

1. The following dimensions were identified as being 
substantive elements in communicating research: 

a. Target audience 

b . Purpose 

c. What 

d. Kow 

Tne dimensions were conceptualized in the model 
below : 




; Science 
! Educators 




School Board 
Administrators 



, Other 
| Educators 






Journals 
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Supervisors 
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2. The supervisor of science is a key individual in the 
dissemination of research and may function as a liaison 
between the research community and the educational 
practitioners — teachers , administrators. 

3. An effort should be made to identify and encourage 
mission oriented research rather than the traditional 
view of individual efforts. 

4. The following questions, which need further discus- 
sion and research, were generated: 

a. In the structure of administrative staff, who 
is the best target for conveying research? 

Is it the supervisor? In all cases? In 
what cases? 

b. Can we put research into a form for dissem- 
ination to schools, that its assimilation 
and continued communication can be enhanced? 

Who will be responsible for interpretation? 

c. Is there a preferred form for reporting research? 

d. Should universities develop care areas for re- 
search. i.e. be mission oriented? 

e. How can existing avenues, such as ERIC, be used 
more effectively? 

f. Does the vehicle stimulate practical use? 

Another group of trainees dealt with problems of dissemination of curri- 
culum information. This group was chaired by Professor David Lockard of the 
University of Maryland. This group was comprised of individuals involved in 
one way or another in the development of curriculum or in the dissemination of 
curriculum information. Their direct involvement in these areas was the primary 
basis on which they derived a summary form for the problem of curriculum dissemi- 
nation. The following outline represents the organization of science education 
research topics identified as of contemporary significance. It was suggested 
that all are worthy of investigation. 

I. Information distribution model 

A. Concise summary reporting of curriculum 
development at various levels : 

1. Local 

2. State or Regional 

3. National 

4. International 

B. Implementation reporting 

1. Methods of implementing projects 

a. Community involvement 

b. Local staff involvement 

c. Budgetary problems 

d. Selection procedures 
II. Teacher preparation model 

A. Direct involvement with Project/University/ 

Regional Lab 

B. Leadership conferences for teachers of 
teachers 
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III. Studies related to the dissemination role of: 

A. Project-publishing house combines 

B. Professional organizations 

C. Parent organizations of sponsored projects 

D. Professors of Science Teaching Methods 

E. Professors of Science (subject matter) 

Under the chairmanship of John Montean of the University of Rochester and 
Stephen Winter of the State University of New York at Buffalo, one group addressed 
itself to problems of research on teaching styles. The group suggested attention 
to the following characteristics of teaching style: 

1. Teaching style is an important variable only because it 
has an influence on pupil growth. 

2. Teaching style is the composite of teacher behavior in 
a variety of dimensions that can be individually 
measured : 

a. Nature of content objectives 

b. Affective, aesthetic, and other non-cog- 
nitive objectives 

c. Tactics of teaching employed 

d. Assumptions about learning 

e. The learning environment 

3. In research on style, attention should be given to 
style using tactics in new as well as conventional 
environments . 

4. In the domains of style that can be measured by 
Flanders Interaction Analysis, research has begun to 
produce empirical evidence regarding the relation- 
ship between this domain of style and pupil learning. 

This research should be developed to the point that 
generalizations can serve as guides to teachers 
after self-analysis of performance. Additional re- 
search or. style, likewise, should seek the goal of 
guidance to teacher performance. 

5. The group recommends to the science education research 
community and NARST: 

a. Publication of summary articles with critical 
analyses of the state of development of research 
and measurement tools in the dimensions of 
teaching style. 

b. Organization of Symposia on Research in the 
dimensions of teaching style at national meetings 

c. The incorporation of a Work Session on Flanders 
type instruments at the next NARST Research 
Training Conference 

d. Additional Work Sessions to train for research 
on teaching style 

Somewhat related to the work of the group focusing on problems of research 
on teaching style was the work on research on teacher characteristics. This 
group was chaired by Professor Willard Jacobson of Columbia University and 
Professor Wayne Taylor of Michigan State University. During these Problem Ses- 
sions, the trainees discussed various issues involved in research or teacher 
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_ following oroblems were identified as important, 

cr.aract^ris tic» . x “ L - 1 U - LJ -' J ° • 

I. How car. we make certain that the research Problems 
that Wv- identify are significant in the social con 

text of our times? __ . 

2 Who stays in elementary school teaching and who 

doesn’t? in particular, what are the characteris- 
tics of those who drop out? What are the chara 
teristics of teacher education programs whose 
graduates tend to stay in teaching? . 

3. What are the distinguishing characteristics o 
teachers that tend to be successful with regard 
to the various criterion measures we use. 

4. What kinds of institutional settings are con uc 
to research? Are there ways that researchers who 
have heavy teaching and administrative loads can 

still do research? 

5. What personal characteristics of teacherscanac- 
tually be changed? What are some successful ap 
proaches for changing such characteristics. 

6. How can changes in teaching styles be accomp 

in academic year institutes? a ___ 

7. How can we replicate studies so that we can gen 

lize from them? - . 

8. How can various media be used most effec ive y 

teacher education? 

9. Should we have programmed research effor s. • * 

should each researcher take on the re ®P 0 £ slb ^ J 
of identifying the problems that he thinks are ®o 
significant? What is the appropriate mix of these 

two approaches? 

10. What are the characteristics of teachers who are 

most successful in difficult urban school settings. 

II. Can we compile a list of research instruments 
available for use by science education researchers. 

A group of trainees under the chairmanship of Professor Robert Buell of 
the University of Toledo directed their attention to the role of inquiry in 
teaching. This group set forth a number of assumptions regarding inquiry tea 
and then identified clusters of questions that can be researched. These were as 



follows : 



f! SU Inqui § is a set of processes applied to a conceptual 
framework of a knowledge . 

In inquiry teaching, teachers provide students with 
the opportunity to structure their own knowledge. 
Inquiry involves certain identifiable process skills 
by whicdi knowledge is formulated. .... 

Inquiry teaching will provide learners with skills 
and behaviors that are both of broad applicability, 
and of long tenure in a rapidly changing culture. 

The teacher as inquirer behaves different y rom 
teacher as purveyor. 



2 . 



3. 



4. 
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Inquiry teaching, as defined by our task force, 
consists of those teaching behaviors which help learners 
develop a propensity for and skills in: 

a. asking questions about the natural world, 
l). gathering information relevant to these 
questions, and 

c. organizing and assimilating this inf or— 
mat ion . 

Two varieties of inquiry teaching are presently extant. 

In one of these , which we called unstructured inquiry 
teaching , students inquire freely, formulating their own 
questions, gathering information and making interpreta- 
tions on their own. The other main variety we called 
structured inquiry teaching . In this considerable guidance 
is given to the students as they inquire, usually by 
stating the questions about which they are to gather infor 
mation and then make interpretations. Although there are 
man y mutations of each, these two main forms reasonably 
describe the inquiry teaching formats. 

A universe of research questions can be raised rele- 
vant to inquiry teaching. Below a few constellations of 
research questions are pointed at, and some specific exem- 
plars are given. 

Questions relating to students 

1. What learning outcomes emerge from unstructured inquiry 
teaching? What learning outcomes emerge from structured 
inquiry teaching? 

2. Can students' questioning behaviors be attributed to 
modeling the teacher* s questioning behaviors? Does 
this vary if teaching is done by machine? 

3. What are the characteristics of questions asked by 
students in an unstructured inquiry teaching situation? 

4. In what ways do personality, intelligence, prior experi 
ence in inquiry situations and school achievement influ 
ence students* responsiveness in structured and unstruc- 
tured inquiry teaching situations/ 

5. What impact does training in specific inquiry skills 

have on students* ability to carry on unstructured inquiry? 
to carry on structured inquiry? 

6. To what extent can children be trained in the strategies 
of inquiry? To what extent must children discover their 
own personalized strategies of inquiry? 

7. How can researchers assess students* ability to ^ 

a. ask researchable questions, 

b. collect information relevant tc these 



questions, 

c. make interpretations of this information? 

8. How can reliabxe, valid instruments be developed to 
measure students* inquiry capabilities? 

9. What experiences will enhance students propensity 
to "transfer" inquiry skills? 

10. Can personality characteristics of children be iden- 
tified that influence inquiry, teaching behavior? 

Questions relating to teachers * personal charac teristics 

1. Can personality characteristics of teachers be iden- 
tified that influence inquiry teaching behavior? 



What personality variables of teachers enhance or de- 
tract from inquiry teaching? 
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3. What social cultural factors in teachers back- 
grounds, and what differences between students and 
teachers may influence inquiry teaching behavior 
and outcomes? 

Questions relating tc teacher training variable s 

1. In what ways can prospective teachers* role expec- 
tations be changed to better prepare them for 
inquiry teaching? 

2. How can the "modeling" effect of 16 or more years 
of didactic teaching be overcome to prepare pros- 
pective teachers for inquiry teaching? 

3. Does inquiry teaching consist of isolable behaviors 
wh; .*> can be identified and for which prospective 
teachers can be trained? How can this training be 
accomplished? 

4. Can teacher behaviors be identified that are re- 
lated to students* success in inquiry? 

Questions rel ating to organizational variables 

1. Do teams of teachers tend to sustain inquiry 
teaching behaviors more readily than isolated 
teachers? 

2* What reward systems will be necessary to sustain 
teachers * adaptation from a didactic to an inquiry 
teaching odel? 

3. What possible organizational restructurings might 
stimulate teacher— pupil interaction or interactions 
between teachers with a resultant enhancement of 
inquiry teaching? 



There were a group of participants who indicated special interest in 
topics other than those suggested to the trainees. These individuals formed a 
group which we labeled Special Topics. This group proved to be heterogeneous 
in interests, but nevertheless they did succeed in identifying a number of 
researchable areas that included their areas of interest. The following sug- 



gestions were 

1 . 

2 . 

3. 



4. 



included in the report from this group: 

What are the characteristics of school pupils who 
a* reject the opportunity to learn? 
b. accept the opportunity to learn? 

What differences exist between the teachers' and 
children's perception of science class tasks? 

How can these be detected, described, evaluated? 
What are the possibilities in the use of "unob- 
trusive" measures as research techniques in eval- 
uation of science education conditions and prac— 
t ices ? 

How can science education be studied in its eco- 
logical realm - the community, building, location 
and relationship with respect to otner disciplines? 
There is need for research in the development and 
use of a variety of measures on students regarding* 
a. Their rationality as they enter society. 
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1) The kinds of arguments they use in support 
of actions. 

2) How much use, through application and 
reference, they make of empirical findings. 

3) How much and in what ways they are reactive 
to their environment. 

b. Tbeir understanding of science and technology 
as social activities. 

1) Are their expectations realistic? 

2) Do they understand the constraints placed 
on science and scientists? 

c. Their understanding of their environment. 

1) Are their expectations of the natural world 
realistic? 

6. There is need for the development of a vocabulary based 
on evidence about teacher behaviors, techniques, etc., 
similar to that which arises from test scores descrip- 
tive of certain student characteristics - a vocabulary 
which would make possible the sharing of what teachers 
are doing in their classrooms and why they operate in 
this manner. 

It is evident from the foregoing that the Problem Sessions were not 
research training sessions in the formal sense. Nevertheless, skills are of 
little value until they can be applied to problems where fruitful results can 
emerge. Though the style of the Problem Sessions was informal and bordered at 
times on the fringe of dubious "bull sessions," the summary reports from the 
groups suggested that considerable value did emerge from these Problem Sessions 
This was also borne out by the evaluation reported below. 



Evaluation 

The evaluation for each of the work sessions was conducted by the Work 
Session leader. The objective of the evaluation was to assess the degree to 
which the program training objectives were achieved. They also served the 
purpose of providing information to the session leaders and to the Program 
Director on which recommendations for the design of future research training 
programs could be based. 

In the Work Sessions led by Professor Walbesser, a specific set of 
objectives were established. A list of objectives and the assessment tasks 
for these objectives is given in Appendix E-l. It was possible to review the 
assessment tasks and to determine the success of this portion of the training 
program. Walbesser reported that all trainees succeeded in acquiring the 
first eighteen competencies. Time did not permit completion of the remaining 




- 15 - 



training materials and assessment tasks. It was Professor Walbesser's ap- 
praisal that the participants did acquire the specified research competences 

measured by the assessment tasks utilized. 

The Sessions conducted by Dean J. Myron Atkin were substantially dif- 
ferent than the other five Work Sessions. There was no attempt to train 
participants in specific research competencies but rather to look at broader 
issues affecting the science education research community. The Work Sessions 
dealing with policy for science education research and science education in 
general discussed the problem of increasing the influence of the science 
education research community in national councils where policy is ultimately 

made. 

The Work Session dealing with policy for science education research and 
science education in general discussed the problem of increasing the in- 
fluence of the science education research community in national councils where 
policy is ultimately made. A communications gap was identified which * it was 
suggested, could be traced in part to a lack of external credibility of the 
research of science educators. 

The credibility gap, it was agreed, has roots in the inability of science 
educators to make their research relevant to curriculum directors and others 
who cope with science education problems "in the real world". Among the 
problems seemed to be fragmented studies, restricted categories of research, 
lack of programmatic studies, lack of communication among investigators at 
different institutions. Among solutions suggested was institutional 
specialization in research. 

Regarding the restriction on styles of research, it was agreed that to 
make research in science education useful to the schools, the question and 
its appropriateness not the style must be the guide. The purpose for in- 
fluencing teaching and the possibility of using the findings in schools are 
the determining factors in judging the value of a study, not its adherence 

to some hypothetical model of "good" research. 

As examples of important school needs not adequately met by current 
activities of the science education research community are interpretations of 
findings that can be read by teachers and supervisors and that consider the 
conditions of pupils and teachers in schools, broader attention to the con- 
cerns of practicing teachers, and other involvement with school conditions. 
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The group also discussed the importance of developing the base data and 
hypothetical projections for questions of science education policy. It was 
recognized that national policy is legitimately developed by inputs from many 
different groups and that our influence can only be as great as the quality 
of our advice. 

The group appreciated this opportunity to discuss, for a relatively 
protracted period of time, questions of formulation of science education 
policy. In the opinion of the participants these questions deserve top 
priority and this conference provided a timely opportunity to consider them 
at length . 

The Work Sessions dealing with curriculum evaluation strategies was 
led by Professor Wayne Welch. The attempt to present methods for attaching 
questions of curriculum evaluation were successful in the opinion of the 
Work Session leader. Individual participants commented on their own ex- 
periences in the sessions and some of the partial quotations from their 
reports are as follows: 

•'The Work Session on curriculum evaluation has been exceedingly 
stimulating and helpful primarily due to the expertise and extensive 
preparation that Dr. Welch brought to the Session." 

"This Work Session was the most rewarding part of the training pro- 
gram. The practice of providing us a series of papers, instruments, 
and strategies for curriculum evaluation was most appropriate for a 
conference of this length. For my particular purpose this type of 
training was very helpful. I commend this procedure for future 
use." 

"I will return home with a substantial number of relevant and use- 
able papers, ideas for research problems and a number of new and 
potentially productive contacts with innovators in the field — 
the latter being what I consider my most valuable acquisition 
from the program." 

"The Sessions brought together into sharp focus problems , tech- 
niques, resources, references, and experiences which would have 
taken months for an individual working by himself to arrive at, 
discover, ferret out or obtain." 

These quotations indicate that the kind of skills being presented and 
the evaluation work done in this series of Work Sessions was valuable to the 
trainees • 

The Work Sessions dealing with conceptual analysis of classroom behaviors 
was led by Professor John Easley. During the first session the participants 
viewed two tapes dealing with PSSC materials. Participants learned that 
conceptual analysis of classroom interviews is closer to formative than 
summative evaluation, but is perhaps most effective if it precedes new cur- 
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riculum planning because of the surprising new entry points it suggests for 
instruction in the given subject. The participants learned that children 
react differently to different interviewers and learn the value of video- 
tape in permitting analysis of the behaviour observed. Some of the com- 
petencies required included a technique for evaluating children* s performance 
via video tape, evaluation techniques associated with audio-tutorial in- 
struction, methods for identifying defects in teacher education programs 
and clues to the improvement of these programs. The use of the techniques 
presented in these Work Sessicns also suggested a number of new research 
possibilities to the participants. 

The Work Sessions led by Professor Duncan Hansen dealt with the use of 
computers in science education research. The intent was to provide par- 
ticipants with information and new contents regarding the role of computers 
in science research and curriculum planning. The evaluation forms of 
participants in these Work Session* indicated that they acquired com- 
petencies in understanding general techniques for programming CAI with 
respect to whole course and part course materials* including writing and 
evaluating global and detailed behavioral objectives. An understanding of the 
contrast between Ausubelian and Piagetian models of development and cognitive 
growth and appropriate research techniques for within and between model 
testing were acquired. An extension of "inquiry skill" in research with 
CAI and CMI models was provided. Participants learned to discern research- 
able areas in teacher characteristics and teaching style using computer 
mediated approaches. A further evidence of the value of these Work Sessions 
was indicated in that half of the participants planned a continuing dialogue 
on some of the topics presented in the Work Sessions with Professor Hansen. 

In the Work Sessions led by Professor Joseph Novak, the objective was 
to present enough of the nature of David Ausubel's learning theory that this 
could be utilized in the analysis of research studies and in the design of 
new research. Selected published research was distributed to the participants 
and each participant was asked to interpret portions of the research in terms 
of constructs in Ausubel's learning theory. Though the time available in the 
sessions was relatively brief, at least one trainee could state in his sum- 
mary report on the training sessions, "I was introduced to a specific theory 
of learning and became well enough acquainted with the theory to apply it 
to research design and analysis. I had practice in conversing within the 
'framework* of the theory and also had practice in analysis in terms of this 
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learning theory. I was also stimulated to start making preliminary research 
designs using this theory.” Comments by others support this appraisal. 

The evaluations of the Work Session leaders as well as the evaluations 
presented at the summary sessions on Friday, indicated that the Work Sessions 
did succeed in developing research competencies and related skills by most 
if not all of the participants. It was difficult to get both trainees and 
many of the leadership personnel to be highly specific in their appraisal 
of the skills and competencies achieved during the training sessions. 

Partly for this reason a questionnaire was mailed to all participants im- 
mediately following the training sessions. This questionnaire contained 
four items. 

1. As a result of the NARST Research Training Program, I gained 
competence in the following research skills: 

2. The most valuable part of the program for me was: 

3. The least valuable part of the program was (provide reasons for 
your answer, if possible): 

4. Participants I would recommend for leadership roles in future 
training programs are: 

Most of the questionnaires were returned promptly by the participants. 
With some follow up correspondence all participants returned questionnaire 
forms. Copies of these are included in Appendix E-2. 

The responses to the first question on the questionnaire varied widely 
depending on the Work Sessions that the participants engaged in. In general, 
almost all participants were able to identify specific research competencies 
and skills that they obtained in the Work Sessions. The response of some 
participants was highly specific and indicated clearly the competency gained. 
A. few respondents could not identify new competencies that they gained, 
which might be partly an indication that the heterogeneity of the group 
was too great for the type of program planned. 

The responses to question two on the questionnaire indicated that the 
most valuable part of the program was the Work Sessions. Equally important 
was an opportunity for informal discussion and exchange of ideas with col- 
leagues. Many participants found value in the Problem Sessions, but the 
responses to question three indicated that at least some of the Problem 
Sessions were not productive and could have been eliminated. The weakest 
portion of the program apparently was the brief presentation by each of the 
Work Session leaders on Wednesday. These presentations did not provide 
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sufficient depth in the subject to be covered in the Work Sessions to be of 
value to the participants and should be eliminated in future training programs. 

In general, the evaluation forms indicate that increasing the homo- 
geneity of the trainees would improve the quality of the training program. 

Also, more emphasis should be placed on intensive training in work in sessions 
similar to the Work Sessions. Although a number of participants found the 
Problem Sessions valuable, many suggested that the kinds of issues presented 
in Problem Sessions should be discussed informally during luncheons or in 
evenings. It is the Director's evaluation that the Training Program could 
be shortened to two intensive days of training similar to that in the Work 
Sessions. Evening hours could remain free for informal discussions, 
although provisions should be made for meeting rooms where trainees can 
associate to discuss issues of interest to them. 

The support facilities that were mac available in the form of secretarial 
assistance and ditto duplication were of some value to the conduct of the 
sessions. However, materials tended to come in on very short notice and in 
quantities too large for two secretaries to handle. At other times, the 
secretaries found themselves without work. It mignt be more desirable to 
arrange for xerox facilities where hand written materials could be copied 
immediately and not require typing on to ditto masters. 

Participants in the Training Program were complimentary regarding the 
overall physical arrangements at the Hotel and procedures established to 
provide travel and living reimbursement by the afternoon of the last training 
day. In the Director's opinion a fine esprit de corps existed among the 
group, indicating that participants were generally satisfied with the ex- 
perience and would be interested in further participation in training pro- 
grams of this type. Suggestions for new leadership personnel were provided 
by the trainees in response to item four on the questionnaire form. It is 
hoped that NARST can sponsor training programs for research workers in 
science education on an annual or biannual basis . 
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A-l. NARST Tentative Program 




1969 RESEARCH TRAINING SESSIONS 
INFORMATION & APPLICATION FORM 



NATIONAL 
ASSOCIATION FOR 
RESEARCH 

IN SCIENCE TEACHING 

A grant from the Training Research Branch of the U.S. Office of Education will make it possible 
for NARST to conduct a research training session during November, 1969. The sessions will be held 
in Chicago during November. 

TENTATIVE PROGRAM OUTLINE 
for a 

RESEARCH TRAINING PROJECT IN SCIENCE EDUCATION 
Chicago, Illinois, November 12-14, 1969 

Session I. Wednesday, November 12, 1969, 9:00 A.M. 

Chairman: Willard Jacobson 

Topic: Translating learning theory into research hypotheses in science 

education 

Speakers: John A. Easley, University of Illinois 

Joseph D. Novak, Cornell University 
Work Sessions 

Session II. Wednesday, 2:00 P.M. — Continue Session I. 

Session III. Thursday, November 13, 9:00 A.M. 

Chairman: Clarence Boeck 

Topic: Identification of techniques and skills needed by science education 

researchers 

Speaker: Henry Walbesser, University of Maryland 

Work Sessions 

Topic: Experimental and Evaluative Designs 

Speaker: Jack Merwin, University of Minnesota 

Work Sessions 

Session IV. Thursday, 2:00 P.M. 

Chairman: T. Wayne Taylor 

Topic: Promising Research Directions in Science Education 

Speaker: J. Myron Atkin, University of Illinois 

Work Sessions 

Session V. Friday, November 14, 9:00 A.M. 

Chairman: Darrel Barnard 

Topic: Technology and science education research design 

1 . CAI and research — Duncan Hansen 

2. Evaluation of learning aids — Wayne Welch 

3. Audio-tutorial techniques and research — Samuel Postlethwait 
Evaluation sessions will follow each presenter. 

Session VI. Friday, 2.-00 P.M. 

Chairman: James Robinson 

Final evaluation and summary sessions: 

1 . Selection of research workers — Frederic Dutton 

2. Resources for research training — Richard Harbeck 

3. Changes needed in university programs — Fletcher Watson 

4. Research design and data analysis — William Cooley 

Participation in the NARST 1969 Research Training Session is not restricted to NARST MEMBERS. The program is 
intended for persons who are engaged full or part-time in the conduct of science education research activities. 
Neither fees nor tuition is charged for ony of the sessions. Travel allowance and per diem allowances will be 

provided. 

Applications will be processed in the order they are received. Applicants are encouraged to apply early 
since the program is limited to 50 participants. Most applicants may expect to be notified of the decision wf the 
selection committee within three weeks after the receipt of their application. 

Return to: Prof. J. D. Novak 

Division or Science Education 
Stone Halt 

• Cornell University 

Ithaca, N.Y. 14850 



Application For NARST Research Training Session 



GENERAL INFORMATION 



1 . 



2 . 



Name: 

Mailing address: 



Lott 



First 



Initial 



3. Sex: M F Age: Telephone No.: 

4. Present Institutional Affiliation (e.g., UCLA): 



5. Have you attended an AERA training session in the past? Yes No 



If “Yes,” when: 

EDUCATIONAL HISTORY 


and which one: - 






7n AAnctorc Srhoftl? 


Year of Degree 


b_ Doctoral School: 


Year of Degree 


Major 




Major 





8a. Record in the blank the approximate number of courses you have taken at either the undergraduate or graduate 
level in each of the following areas: 

a. Anthropology 

b. Biology 

c. Chemistry 

d. Curriculum 

e. Earth Sciences 

f. Educ. Measurement or Psychometrics 

g. Electronic Computers 

EMPLOYMENT INFORMATION 

9a. Describe briefly the nature of your present employment: 



h. Linguistics 

i. Mathematics (excluding math educ.) 

j. Physics 

k. Psychology (Exper., Soc., Devel., or Learning) 

l. Sociology 

m. Statistics and experimental design 



b. Describe briefly any changes you expect in your employment during the coming year with respect to either 
employer or type of activity: 



10a. What percent of your time is allotted to teaching? b. To research? c. To grad, study? 

11. Which courses do you teach (if any), at what level (undergraduate — U.G — or graduate — G), and what text 
book (if any) might you typically use? 

Course Level Textbook 

' U.G G 





U,G 


G. 


U.G. 


G. 


PROFESSIONAL AND SCHOLARLY INTERESTS 

1 3 What are vour primary research in^rests? 


15. How many funded (by USOE, NIMH, NSF, Ford 




Foundation, or other granting agencies) research 




projects are in progress or completed on which your 




name appears as either the first or a joint author? 



, . , ... 16. List no more than three professional societies. . 

13. Approximately how many research articles which 

you have authored alone or jointly have been 

accepted in a scholarly (refereed) journal? 

14. In total, about how many research articles, theses 

or technical reports (both published and unpub- 17. Describe briefly your reason for applying, 
iishedl have you authored’ alone or jointly? (use separate sheet) 
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Appendix 



List of Participants 



NARST Research Training Program 



Atkin, J. Myron 
Easley, John A. 
Hansen, Duncan 
Novak, Joseph 1). 
Walbesser, Henry 
Welch, Wayne 



Anderson, Harold M. 
Arnold, Daniel S. 
Awkerman, Gary L. 
Berryman, William C. 
Bingman, Richard M. 
Bocck, Clarence H. 
Boener, Charlotte M. 
Bowles, Joseph E. 
Bridgham, Robert G. 
Buell, Robert R. 
Butts, David P. 
Cleaver, Thomas J. 
Doran, Rodney L. 
Dyrli, Odvard E. 
Fitzgibbon, Robert 
Fowler, H. Seymour 
Gallagher, James J. 
Hanson, Robert W. 
Harbeck, Richard M. 
Hassard, John R. 
Hein, Harold C. 
Helgeson, Stanley 
Jacobson, Willard 
James, Robert K. 
Jerkins, Kenneth 
Koutnik, Paul G. 
LaShier, William S. 
Lockard, J. David 



Work Session Leaders 



University of Illinois 
University of Illinois 
Florida State University 
Cornell University 
University of Maryland 
University of Minnesota 



Participants 



University of Colorado 

University of Kentucky 

Charleston, S.C. County Schools 

Sylacauga, Alabama Schools 

McREL, Kansas City, Missouri 

University of Minnesota 

Indiana State University 

University of South Carolina 

Stanford University 

University of Toledo 

University of Texas 

University of Colorado 

State University of New York at Buffalo 

University of Connecticut 

Greece Central Schools, Rochester, N.Y. 

Pennsylvania State University 

Educational Research Council, Cleveland 

University of Northern Iowa 

U.S. Office of Education, Washington, D.C. 

Georgia State University 

University of Mississippi 

Ohio State University 

Columbia University 

Kansas State University 

Morgan State College 

McREL, Kansas City, Missouri 

Kansas State Teachers College 

University of Maryland 



McCurdy, Donald W. 
Menefee, Robert W. 
Merkle, Dale G. 

Monte an, John J. 
Myers, Gerald A. 
Nelson, Clarence 
Novlck, Seymour 
01s tad, Roger G. 
Oshlma, Eugene A. 
Pella, Milton 0. 
Postlethwait , Samuel 
Schaff, John F. 
Schimer, Silas W. 
Schmidt, Donald J. 
Schmuckler, Joseph S. 
Smith, Herbert A. 
Taylor, Wayne 
Trent, John H. 

Twee ten, Paul W. 
Uffelman, Robert L. 
Voelker , Alan M. 
Watson, Fletcher 
Winter, Stephen 
Wood, Roger L. 

Yager, Robert E. 



University of Nebraska 
University of Maryland 
Shippensburg State College 
University of Rochester 
South Dakota State University 
Michigan State University 
Temple University 
University of Washington 
Central Missouri State College 
University of Wisconsin 
Purdue University 
Syracuse University 
University of Houston 
Fitchburg State College 
Temple University 
Colorado State University 
Michigan State University 
University of Nevada at Reno 
University of New Mexico 
University of Delaware 
University of Wisconsin 
Harvard University 

State University of New York at Buffalo 
Wisconsin State University 
University of Iowa 



* 



U.S. 



Office of Education Observer 



Appendix 



B-2. Date Summary 



o 

ERIC 



DATA SUMMARY 



A. Applications 

1. Requested 735 

2. Returned 309 



B. Applicants 

1# Male 268, Female 4l 

2. Average Age 37 

3* States Represented 41 

4. Highest degree: B.S. 18, M.A. or M.S. 166, Ed.D. or Ib.D. 125 

5. Prior attendance at a research training session: yes 7, no 302 

C. Participants 

1. Male 49, Female 1 

2. Average Age 4l 

3. States Represented 27 

4. Highest degree: B.S. 0, M.A. or M.S. 1, Ed.D. or Fh.D. 49 

a. Average year that highest degree was awarded: 1962 



b. Major subject: 

1) Astronomy 1 

2) Biology 1 

3) Biology-Science Education 2 

4) Botany 1 

5; Chemistry 1 

6 ) Curriculum & Instruction 5 

7) Education 1 

8 ) Geology-Science Education 1 

9) Plant Physiology & Plant Science 3 

10) Science Education 31 

11) Secondary Education 2 

12) Teacher Education 1 

5. Prior attendance at a research training session: yes 5> no 45 

6 . Present employment: 

a. College and university professors 42 

b. Researchers in institutions engaged 

in educational research 5 

c. Directors of science, curriculum 

and instruction in public schools 3 

7. Anticipated changes in employment: 

a. No major changes 32 

b. More research involvement 12 

c. Seeking new positions offering 

increased research opportunities 2 

d. In process of defining newly 

created position 1 

e. More administrative duties 3 

8 . Per cent of time allotted to: 

a. teaching 47 

b. research 33 

c. graduate study 6 

d. other (primarily administrative 

duties) 14 




9. Nature of courses taught by those in colleges and universities 

($ in each category) 

a. Methods and other science education courses 66 

b. Research training 12 

c. Science (e.g, botany) 11 

d. Curriculum, learning theory, general education courses 11 

10. Primary research interests: 

a. Attitudes, and confidence in teaching; of non-science majors 
toward science; changes; impact of knowledge on attitudes; 
student attitudes toward science 

b. Instruction , comparison of methods; design, evaluation and 
use of methods and materials of instruction 

c. Evaluation , of achievement; learning aids; media; student 
teaching; teacher competencies. Construction of evaluation 
instruments 

d. Cognitive development and learning theory 

e. Curriculum development and evaluation 

f. Teachers , role expectations; education; behavior; characteristics; 
effectiveness; competence; personality, change. 

g. Studies in biology or conservation 

11. Average number of research articles and technical reports authored 

by participants either alone or Jointly: 15 

12. Some reasons for applying: 

a. To become familiar with current content, methodology and 
emphases in science education. 

b. To update and improve research techniques and skills in order 
to improve the quality of research. 

c. To interact with others doing research in science education. 

d. To be better prepared to supervise doctoral students or 
others doing research. 
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Some Exerpts from Writings 

John A. Easley 
University of Illinois 



The Need for Conceptual Analysis in Science Education 

Scientists are accused frequently these days of being unable (or 
unwilling to communicate their technical knowledge to the public effectively, 
in a time when technical information carries a heavier and heavier burden 
foreboding doom for both natural wilderness and civilization alike. Scientists 
whose biases are showing may well be the hottest commodity on the consultant 
market. The public is becoming increasingly aware that any given data can be 
variously interpreted by scientists of different persuasions, building an 
attitude which threatens the scientific establishment with a widening credi- 
bility gap. Even science teachers and science educators are saying, "We 
can't teach facts because, whatever we teach may well be changed in another 
decade." What is desperately needed is an understanding of the way differences 
in conceptual frameworks and social value systems can generate controversy 
in science without undermining the values of honest reporting and criticism 
which give the scientific profession its growth potential and therefore its 
value to society. 

Science educators should, in my opinion, be investigating this problem 
as it expresses itself in science classrooms and should neither attempt to 
argue it away by dogmatic statements about the nature of science nor sit 
aback and wait for philosophers to figure out the answer. Who knows, perhaps 
a more realistic confrontation with the human phenomenon of misunderstanding 
science would help philosophers in theory building. 

That the value of open criticism as a way of advancing knowledge is poorly 
understood by the public at large is evidenced by the unwillingness most people 
show to engage in public controversy or to admit that they may be in need of 
more exposure to information and argument. We do our "town meeting" vicariously 
by watching TV and reading letters to the editor. There is little guarantee 
in all this that the values of open criticism which advance scholarship can be 
adequately realized in a society where decisions are based on testimonials. 

Science classes, which could do much to uphold the ideal of open debate, 
often succeed in surpressing debate by the allegedly scientific challenge, 

"How can you collect evidence to find out if you are right?" This question 
too often leads to Innumerable experiments which are often undoable. Science 
teachers can ill afford to encourage their students to put forth their own 
ideas, if they must take the time to try to resolve every issue raised in 
this way by the collection of decisive evidence. Yet, without the freedom 
for students to attempt explanations of phenomena, which they have observed 
in terms of their own preconceptions, how can teachers persuade them of what 
they know except by appeal to authoritative opinion? 

But besides the public good there is a more direct value in this sort 
of study. Evidence that is convincing to a scientist who is familiar with 
possible alternatives, and the evidence against them. 
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nay not be, and ordinarily should not be expected to be, convincing to 
a student who is just beginning to study the phenomena in question. 
There is a great need to find out what students typically think about 
phenomena before teachers and eurriculun developers decide on the 
particular experiences and theory to be presented in scienoe classes. 

Still a third reason for study of student arguments and theory is 
to acquaint prospective scienoe teachers with typical cases of what 
they will confront. They need to be prepared both for the specific 
theories which students typically hold and the style of argument and 
manner of evidence which students judge relevant to their beliefs. 

By presenting the standard evldenoe as though to convince students of 
a standard conclusion, we are often attempting to convince students of 
the value of evidence. However, if they do not already believe in the 
value of evldenoe, will they find the evidence convincing! One typi- 
cally assumes either (1) that students already believe in the conclu- 
sions that scientists draw (and thus that they are learning about the 
criteria of confirmation) or (2) that they already have our criteria 
for judging the adequacy of evidence. But what we ought to expect is 
that they have neither, but they might have conclusions and criteria 
of their own. 

A fourth reason for researoh into students thinking about their 
world— science, in other words— is to develop more useful diagnostic 
instruments and procedures for evaluation of student understanding. 

We must learn to cou^t it a failure when physios students genuinely 
accept neither Newtonian mechanics, nor Einatelnfe ideas of general 
relativity, though they demonstrate ability to solve problems and judge 
that the evldenoe and the theories are not discrepant. When students 
persist in their own quasi-Aristotelian theory of motion, an the view 
that theories come and go and therefore they have m much right to an 
opinion on what makes things move as the next man, we have failed to 
coamiuiicate a modern method of acientific reasoning. But our teats are 
passed quite satisfactorily. 

The point is that students have the right to be convinced by evi- 
dence and argument, but teachers have no right to drop their effort if 
the standard evidence and argument is unconvincing to their students. 
Putting it differently, research is needed into what tne cognitive 
entry behavior of soienoe students i« r Knowing whether or not they 
have a desired piece of terminal behavior o a entry is doubtless useful 
but clearly insufficient to plan instruction that will conneot new 
experiences with present concepts, beliefs, and styles of evidence and 
argument. 

Philosophical analysis, in which concepts and presuppositions of 
arguments are constructed to explain a widespread opinion in soienoe 
or in philosophy, can in principle be practiced in the classroom as 
well as in the study or library. However, widespread employment of 
philosophically trained analysts As school teachers la not likely to 



happen in the near future* By tasking end analysing video-tapes of inter* 
views with children or elassrooia discus alone, however, it should be poc- 
sible to deternine typical student preeonoeptions in a particular science 
course and design ourrioulna and instruction to relate to then* 

Ve can gain a good deal of inspiration for research in this direc- 
tion by examining the work of Jean Piaget and his associates* Sven 
though one may legitimately quarrel with the boldness of his leaps from 
a few protocols to conclusions about tbs development of cognitive struc- 
ture, one cannot so easily escape the evidence that children do develop 
convictions in very unorthodox ways, that these are regularities in their 
ways of thinking, and that interviewing children is going to tell us more 
about these phenomena than testing them or putting them through programmed 
instruction* 
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CONCERNING EDUCATIONAL APPLICATIONS OF PIAGET THEORY 



The possibility of an educational psychology that would guide instructional 
practice has long been discussed, but the guidance accomplished so far has been 
largely in such peripheral areas as classroom management and counseling students 
with learning difficulties. Little has been learned that relates directly to the 
organization of instruction in terms of its subject matter. Cognitive psychology 
has touched on aspects of this Ausubel (1968) but a theory of cognitive develop- 
ment so structural that it could be usefully applied to the precise guidance of 
instruction in mathematics and the sciences, for example, has not yet emerged. 

Piaget's work comes the closest of any to making contact with highly structured 
forms of knowledge, but his theory has lacked a clear enough formulation to 
permit operational testing in detail. A proposed method of analysis, developed 
by Witz, would solve some of the major problems in methodology which Piaget and 
his colleagues have side stepped in their creative theory development. Therefore 
this method promises much greater applicability to the design of curriculum and 
to the training of teachers in science and math than anything else that has been 
• available from psychology. 

The major point of discussion between curriculum developers and Piagetian 
theorists seems to have centered on the limitations that Piaget's findings 
allegedly place on the possibility of accelerating children's development through 
the stages of cognitive 'development (Ripple and Rockcastle, 1964), but closer 
examination of Piaget theory indicates that a more positive contribution to 
education is possible. To challenge these alleged rate limitations because the 
, evidence is inconclusive (Cambridge Conference on School Mathematics, 1963) may 
have led to setting overly optimistic instructional goals, or it may have involved 
a misinterpretation of the structural aspects of the cognitive behavior which 
Piaget describes. (See Easley, 1964, for a discussion of this question.) Recognition 
of the limitations of growth rate has been turned to advantage by workers in several 
curriculum projects and in many British Infant Schools by providing opportunities 
for greater pupil initiative and for learning through manipulation of concrete 
objects. 

Another approach to educational apolications has been that of placing cur- 
riculum material so as to conform to the structural properties of Piaget's 
developmental stages (see, for example, the Macmillan elementary school science 
series). This approach to application is complicated by the fact that rather 
striking differences in development occur within the space of a few months and 
children within an otherwise homogeneous group show marked differences in cognitive 
development. Above all, it is complicated by ambiguities in Piaget theory. There 
is increasingly evident confusion concerning what constitutes a performance at the 
concrete — or at the formal- -operational level, in logical or in mathematical 
problem solving typically required in schools. 

The current pressure to formulate instructional objectives behaviorally, 
which has become a major feature of several curriculum projects attempting to 
individualize instruction, begs the difficult question of how such objectives are 
to be decided upon. Whatever merits may lie in this approach are unlikely to be 
realized unless cognitive structures involved in given tasks and the processes 
whereby children acquire particular intellectual abilities can be formalized. Thus, 
a test of this position could be enhanced by an improved Piagetian analysis. However, 
the implementation of precise instructional goals by means of the careful design of 
instructional materials--even putting them into programmed form— may be effectively 
limited by the social interactions between teachers and pupils, as has been 
demonstrated with programmed booklets merely handed out to pupils by their teachers. 
What is requited is an understanding of the process whereby a child copes with the 
school environment, which includes the teacher, other pupils, and instructional 
materials. 



If the influence of the school environment and teacher on a child's behavior 
are sharply reduced or controlled, as in Piaget interviews, it is often found 
that most children are ahead of the classroom demands in terms of basic intellectual 
skills, but receiving little or no help in applying them in the classroom (VhlST, 
1969a, b, c). The curriculum is typically designed to move gradually from a simple, 
one- or two- variable analysis of phenomena through formal methods like arithmetic, 
graphing, or algebra, to more abstract and complex analyses, but the child often 
has leaped intuitively to the more powerful abstract level of theorizing which is 
difficult for him to formalize or operationalize. One can predict that he will 
consequently be rather discouraged at the slow progress of formal instruction and 
bewildered at what often must appear as an arbitrary adoption of formal definitions, 
methods, and measurement operation in the name of scientific inquiry. 

To be sure, the processes to which the child is being introduced may be 
authentic and recognized as the most appropriate for advancing man's knowledge 
of natural phenomena. However, the child who, for example, has already organized 
his experiences with mechanical phenomena may feel quite confident in his under- 
standing of objects in motion or static equilibrium of forces at an abstract level, 
simply because he has gained a great deal of control over his bodily actions in 
running, jumping, swinging, seesawing, bicycling. etc. If he regularly employs 
dynamical concepts which are more abstract and less operational than the curriculum 
allows, he will lack intrinsic motivation to undertake the fundamentals of measure- 
ment and kinematical description. Moreover, the processes of inquiry judged most 
appropriate for physics, chemistry, biology, etc., today may not be so appropriate 
tomorrow nor at all appropriate in new fields of investigation like ethology, 
genetic epistemology, and classroom interaction. Here, greater reliance on 
intuitive methods may be necessary, since, without a considerable intuitive knowl- 
edge of a phenomenon, it is very unclear as to what should be measured or recorded 
in order to study >it more objectively. 

Piaget's theory provides a means of representing the informal way in which 
children conceive their world, which should make it possible for the educator to 
chart a pathway from their own conceptual frameworks and more intuitive methods of 
inquiry to the more scholarly ones the school seeks to help them attain. By 
bringing them along such a pathway, it should be possible to avoid much of the 
present frustration that both children and teachers experience and to give them a 
more balanced competence in intellectual methods. However, accomplishing this is 
sure to require a great deal more special competence on the part of teachers than 
current instructional methods do. In particular, teachers will have to become 
adept at making on-the-spot judgments as to which of several alternatives is of 
the greatest educational value. This requires ability to judge children's motives 
(whether intrinsic or extrinsic to the matter on which they are working), if the 
latter, whether there is a reasonable chance that intrinsic motivation can arise 
from the extrinsic ones at a given stage of intellectual development. It also 
requires that there should be immediately available, tested materials which children 
are likely to enjoy using and which are likely to provoke them into a desirable 
kind of activity. 

Judging whether any ongoing interaction between children and their environment 
is educationally valuable or not is perhaps usually no more reliable a process than 
judging whether a given competence other terminal behavior, or goal is educationally 
valuable. He lack adequate means of doing either. It may be expected to be more 



valid because activities always need to be justified to children, their parents, 
and teachers as intrinsically valuable. Second grade should be a "good year" not 
just a good preparation for third grade. Perhaps there is merit, from the practical 
point of view of teacher training and teacher assessment, in emphasizing the 
judgment of on-going activities--recognizing that in some instances the ends-means 
continuum starts and stops with a particular value judgment made on the spot and, 
in other instances, that it may be traceable through a complex of causal inferences 
to some more permanently held goal. 



J. A. Easley, Jr. 
October 20, 1969 
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USE OF COMPUTERS IN SCIENCE EDUCATION RESEARCH 



Introduction * — Computers have come to play a more dominant role in both our 

ongoing instructional activities as well as within educational research* 

On the one hand, the computer's capability for resolving problems of 

• # 
accuracy, logistics, and complexity have added significantly to large 

„ group instruction. Perhaps, more importantly for science education research, 

computers allow for process control experimentation. The major point of 

this presentation will be to illuminate how process control experimentation 

in science education may provide more meaningful answers for your future 

research activities. 

Unfortunately, the use of computers tends to be known by the nature 
of their application. When considering the term"Computer-Assisted Instruc- 
tion" (CA1) , one thinks of the following kinds of applications: 

1. Drill and practice that provides a potential automation of 
the problem solving routines or homework to be mastered by a student. 

2. Tutorial approaches that attempt to replace the teacher in 
as complete a manner as possible. 

3. Problem-solving tasks that use the computer both as a problem- 
structuring device and as a calculational device for generating answers. 

4. Simulation that attempts to replace many of the empirical 
activities such as found in a science laboratory with symbolic represen- 
tations handled by the logical and stochastic capabilities of computers. 

5. Evaluation via computer that leads to both sequential testing 
and more sophisticated forms of data analysis. 



These alternative interpretations of CAI are listed primarily to 
indicate the wide range of computer aids to science education research* 

The problem, though, remains one of developing a theoretical framework 
so as to understand under what conditions and for what purposes a com- 
puter can be wisely utilized. For the purpose of this paper, I will 
intersperse questions to hopefully provoke later discussion and gain 
greater insight as to the nature of the conditions and potential payoffs 
from the use of computers. 

Question 1 . — How should we formulate the theoretical framework 

for* the use of computers in science education research, given that the 

range of applications start from "here and now” instructional uses to 

potential, esoteric activities like simulation? 

Question 2 . — How might we separate out the goals of research from 

the goals of instructional development in order to gain greater insight 

as to the potential payoffs from the use of computers? 

As a tentative answer, I have formulated three levels of research 

purposes and associated activities. While initially these three levels 

seem to span along the continuum from basic to applied research, it will 

•become clearer that the nature of the three levels both interact and 

represent complexities among them that are highly important. 

• • 

Level 1. — Behavioral Processes Within Science Education Tasks . The main 
. purpose of many researchers is the identification and explication of 
relationships among the basic behavioral processes within a student as he 

attempts to successfully complete a science education task. Borrowing 

/ . * • 

liberally from experimental psychology as a source of theoretical concepts 
the areas of perception, learning, memory, and rule-governed behavior have 



been looked at seriously via the use of computers. In regards to perception, 
the basic processes of dis crimination, both among simple signals arid sym- 
bolic representations, have been actively pursued by William Uttal at the 
University of Michigan. Utilizing computer control, the approximation steps 
or sp a n of confusibility between two dis crimina table stimuli have been 
•systematically altered in order to better reveal t-he nature of discrimina- 
tion processes. The major outcome has been an elaboration of the complexity 
of the similarity and difference sequencing rules for embedding within an 
educational task. This outcome is of special importance in terms ofc its 
implication for curriculum construction. 

In turn, Gagne has proposed a bierarchial framework for considering 
the complexity of seven learning processes. Utilizing Gagne's backward 
iterative task analysis procedure, colleagues at Florida State University 
are using computers to test out the relationships and sequencing among the 
processes proposed by Gagne for a given science education curriculuin. In 
turn, the role, of memory has come to play a greater consideration within 
people's views of the basic nature of human problem-solving. Such work as 
exemplified by Johnson at the University of Minnesota in focusing oh the 
conceptual associations found within physics exemplify this investigation. 
The role of the computer in this line of investigation has been one of . 
both controlling the timing of input and retrieval events and attempting 
to span the zones of understanding that have been recognized by such 
. people as Brown and Suppes . 

And lastly, investigators such as Jenkins have been closely lobking 
at rule— governed behavior and especially as to how these rules are acquired. 
These rule— governed behaviors may, in fact, characterize much of the 
conceptual understanding found in the physical sciences. Utilizing novel 



tasks, Jenkins has been exploring the nature by which adults infer rules 
to solve complex tasks via the use of a computer. Thus, all of these in- 
vestigators can be characterized as attempting to better understand the 
behavioral processes within an instructional task. Giving secondary im- 
portance to the nature of the task or the precise experimental conditions, 
the role of the computer is primarily one of giving better control over 

the experimental conditions. This leads in turn to the following questions 
• * • . 
Question 3 . — Precisely how does process-controlled experimentation 

via computers give one better insight into the behavior of students? 

Question A . — Should our experimental designs of the future involve 

m 

more sequential stages by which we have a better interaction between the 
experimenters 1 evaluation of the data and the conditions posed in sequence 

for a student within a complex experiment? 

Question 5 .— How might on-line data analysis results Influence 

the growing complexity of these potential experiments? 

Level II. — Instructional Processes Within Science Education . * Researchers 
who focus on instructional processes tend to posit a broader framework 
that involves at least the conceptual nature and structure of the learning 
materials, the current level of performance of the students as well as the 
nature, of the instructional process itself. 

Within the "systems model" for instruction, the first component 

• • e 

t • 

usually concerns the learning goals and curriculum content structure. For 
science education it has been proposed that the basic relationship between 
the structure of the curriculum concepts and the behavioral processes to 

a 

^ . * * 

be gained by the student should have a closer relationship. Perhaps 
computer© might facilitate these relationship* by the simple means of 
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simulating both the content and the student as a series of algorithmic 
steps within a student-curriculum simulator. While this is pure conjecture 
at this point, people are attempting to investigate this possibility, as 
noted by the work of the Stanford group in mathematics. 

In turn, consideration of the entry performance level of the 
students is typically considered. Computers are being utilized for their 
more effective surveying and identification of strengths and weaknesses 
of given students. Third, the role of behavioral objectives has come to 
play almost a major theoretical influence within this second level of 
Instructional processes. How the computer might relate to these behavioral 
objectives in an instructional form is *still in its most exploratory 

stage. 

The fourth component, that of instructional strategy is both the 
most ambiguous, and the one with greatest promise for future research. It 
can be? contended that instructional strategies can be broken down into four 
types oii psychology of instruction. One, there needs to be a psychology 
of directions for instruction, as might be illustrated by the use of flow 
d arts, or sequentially structured steps as opposed to our typical verbal 
directions offered to the students. We have little understanding of the 
functions of directions and how these interact with students. Second, 
there is a need for a psychology of presentation that especially focuses 
on the role of media as it transcends just the best representation of 
concepts. The investigation of student aptitude by media interaction 
is one current example of research in this area. Third, there is a need 
for a psychology of instructor/student dialogues. While naturalistic 
observation schemes have t en utilized in this area, the nature of these 
dialogues can become much more precise as one attempts to implement thea 
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on computer systems. And lastly, there is a need for greater understanding 
of the relationship between the psychology of errors, the process for 
correction, and the assignment of remediation. 

People working in this second level would propose a different way 
of considering the behavioral processes of students in developing new 
psychologies that are distinctly different from that of experimental 
psychology found in Level I. As a last step, computers have played a 
significant role in the evaluation of a new curriculum. This has primarily 
been in more sophisticated ways of relating the outcomes to the particular 
cost. A few remarks in terms of cost-effectiveness might be pertinent 
in one's long term view of a program ot research. This "Systems Approach,* 7 
thus can lead to the following kinds of questions. 

Question 6 . — How might computers be utilized for the analysis 
and generation of new science curriculum materials? 

Question 7 . — How might computers be used in the more appropriate 
assessment procedures for the entry or curren behaviors of students 
within a given instructional sequence? 

Question 8 . — How might computers be utilized for a better dialogue, 
especially in regards to their awareness of an involvement with the 
behavioral objectives of the curriculum? 

Question 9 . — How might computers be utilized within the formal 
investigation of instructional strategies, especially as emphasized 
between the degree of learner control of the process as opposed to the 
instructional systems control? 

Question 10. — How might computers be utilized for a more timely 
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form of evaluation? 
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Level III. — New Instructional Systems for Science Education . There are 
many Investigators who, sounding almost a theoretical in their commitment, 
are attempting to develop new instructional systems. These investigators 
look upon the computer primarily as a problem-solving device to be used 
by the student for gaining greater sophistication and mastery of the goals 
of a given science curriculum. But more importantly, they are attempting 
to develop new science tasks that are more slmpatico with the ultimate 
goals of science education. As examples, there are those who are at temp t- 
ting to automate the homework process and make the prescription of the 
amount of homework a function of both student's performance as well as 
the expectations from the instructional* system. Secondly, many investiga- 
tors are creating new science games, as well as problem solving tasks that 
depend on the computer for solution. In what sense does learning how to 
program a computer add to the behavioral process underpinning of a student 
as he ultimately approaches a career in science. And, last, but perhaps 
most importantly, there is a very active investigation of the replacement 
of many science laboratory activities with computer simulations. Perhaps 
the outcome of this is still premature, but the present results are highly 
promising. While many other new examples of instructional systems tasks 
pg computers could be named and are currently being created at this 
time, the following questions seem to be reasonable results. 

Question 11 . — Can one identify the characteristics of the computer • 
as a problem-solving device that could best match the assignment to some 
science task, be this laboratory or conceptual in nature? 

Question 12 . — How does the cost of technology relate to the ultimate 



cost of these new instructional systems? 



8 






I trust this brief outline and •accompanying flues t lens will prove 
sufficiently provocative that during my oral presentation you will feel 
free to identify the questions most relevant for your current interests 

and commitments • 



Duncan N. Hansen, Director 
Computer-Assisted Instruction Center 
Florida State University 
Room' LA Tuily Gym 
Tallahassee, Florida 32306 
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THE DESIGN OF RESEARCH IN SCIENCE EDUCATION 
ON THE BASIS OF LEARNING THEORY* 

Joseph D. Novak 
Cornell University 



Research Should Emerge From and Contribute To Learning Theory 

In 1963, the Journal of Research in Science Teaching was launched. The 
first paper in this Journal was "A Preliminary Statement on Research in 
Science Education” (7). In that paper this writer argued that there is a need 
for basing science education research on learning theory. It was suggested 
that cybernetic theory may have some value in the design of learning, but that 
there appeared to be no adequate learning theory and virtually no evidence 
that science education research in the past had been based on learning theory. 

Also in 1963 David Ausubel published his book. The Psychology of Meaningful 
Verbal Learning (1). When my students and I first studied this book, we felt 
that Ausubel had assembled what could become a useful theoretical base for 
the design and interpretation of research in science education. The later 
books by Ausubel and his associates (2,3) have expanded considerably the theo- 
retical formulation presented in 1963 and now provide what I believe to be a 
very adequate base for designing and interpreting research studies. 

At this time, then, I submit we have an important theoretical base for 
the design of research in science education. You may wish to explore the 
theoretical suggestions of Bruner (4), Gagne (5), Piaget (6), Smith and Smith (12), 
Skinner (10), or other psychologists, but in the judgment of my graduate students, 
Ausubel presents at this time the most heuristic theory for proceeding in the 
design and analysis of research. 

The critical distinction Ausubel elucidates is between rote reception 
learning and meaningful reception learning . In rote reception learning new 
knowledge learned is not associated to form some kind of conceptual base or 
is not associated with prior concepts; whereas' in meaningful reception learning, 
new knowledge is associated to ideas or concepts in the learner’s cognitive 
structure. The task for effective reception teaching is to plan instruction 
so that new material can be learned meaningfully , and it *s to this end that 
Ausubel directs his attention. 

In figure 1 a schema is shown to illustrate several important elements 
of Ausubel *s theory. Meaningful learning occurs when there exists in the 
learner's cognitive structure some representational equivalent between language 
and mental content. The cognitive structure is represented in figure 2 by 
a network labeled "subsuming concept". Subsuming concepts allow related new 
information to be readily accepted into a learner's cognitive structure, with the 
subsequent loss -of identity or dissociability of the acquired information "bits". 

_ Ausubel refers to this as obliterative subsumption , and this always occurs after 
new information is meaningfully acquired^ Though obliteration of recall of 



* Paper read at the NARST Research Training Conference, Chicago, Illinois, 
November 12, 1969. 
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specific knowledge bits occurs during subsumption, conceptual structure is 
enhanced, thus facilitating further acquisition of new knowledge. An important 
factor is that newly learned material is not immediately subsumed but as time 
proceeds, the new knowledge becomes progressively less dissociable from the 
generalized concept until it can no longer be recalled. Thus, subsuming 
concepts facilitate new learning and short-term retention, but eventual loss of 
discrete knowledge bits also occurs as cognitive structure is elaborated. 
Knowledge bits not associated with concepts may be rotely learned (open 
circles in figure l)or may not be accepted into the cognitive field (repelled 
solid circles). However, rotely learned knowledge suffers relatively rapid 
irretrievability . 



Concepts can be related to each other or to some larger concept . For 
example, the concept of mass and force can be related to acceleration. As 
a learner acquires new knowledge, prior concepts can be gradually subsumed into 
larger, more inclusive concepts. This hierarchical subsumption process in- 
creases further the facility with which new knowledge can be acquired. Not 
only does eventual loss of retrievable knowledge bits result, subconcepts may 
become progressively less dissociable as distinct entities. 

The ideas of subsumption are central to Ausubel*s theory regarding how 
meaningful reception learning proceeds. However, one may ask why new learning 
occurs in areas where the learner has had little or no past experience and ^ 
hence no available subsumers exist. To begin, adults rarely encounter learning 
tasks where some prior ideational framework cannot be applied during early 
learning phases. Subsequent differentiation of new concepts can result to 
facilitate new knowledge acquisition and subsumption processes proceed. For 
' young learners, e.g., elementary school pupils, new learning may be by rote 
until enough information is acquired that subsuming concepts can be formed. 
Ausubel holds that for learning in areas where prior cognitive structure of 
the students may not contain available subsumers, advance organizers can faci- 
litate learning. Organizers are introduced in advance of the material to be 
learned and are presented at a higher level of abstractness, generality and 
inclusivcncss than the content to be learned. For example, children might 
be instructed that the primary center of growth in plants is at the ends of 
the stems. Subsequent instruction may lead them to observe the size of leaves, 
length of internodes and general contrast between the morphology of stems 
near the ends in contrast to lower regions. The statement regarding the 
primary center of stem growth thus serves as an advance organizer . In practice, 
effective instruction for meaningful reception learning would require pre- 
sentation of advance organizers in sequences with appropriate instruction 
spaced between these. Thus our hierarchical series of organizers, in descending 
order of inclusiveness, would be planned into the instructional sequence. 

Figure 2 is a schema to show how advance organizers may serve to associate 
prior rotely learned information and/or to provide "anchorage" or a subsumption 
base for subsequent instruction. 
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Critical Variables for Study 

On the basis of Ausubel's theory, it would appear evident that the 
design instruction should give careful attention to the sequence in which 
concepts are elaborated. Instructional design requires that progressive 
differentiation of major concepts occur in a systematic manner. The use of 
advance organizers in the instruction should facilitate learning. An important 



kind of research would involve what Scrivcn Cl X ) has called formative 
evaluation. Substantial research efforts are needed to see whether or not 
varying sequences of concept presentation results in more rapid assimilation 
of the concepts, as measured by learning times such as the time spent in audio- 
tutorial study, or by the better acquisition of highly differentiated concepts. 
The latter would be evidenced in terms of the relatively greater power of 
transfer of learned concepts to new situations. 



The variable of time is one that is too often Ignored in the design of 
research dealing with science teaching. Frequently we look only at relative 
achievement and ignore completely the time required by students to reach a 
certain level of mastery. Since it is becoming increasingly apparent that 
most normal students are capable of learning the subject matter we have to 
present, the time variable is in many ways by far the most important. One 
of the promising aspects of audio- tutorial instruction is that we have a 
systematic way of monitoring learning time, for most. of the important learning 
occurs in the audio-tutorial study center and it is easily possible to record 
this time as suggested by Postlethwait and others (9). 

• • 

Since we are interested not only in knowledge acquisition but in the 
organization of this knowledge, the research evaluation instruments should 
appraise* the ability of students to solve problems different from those 
presented in instruction as well as the acquisition of factual information. 

The quality of concept learning is probably be.st Indexed by the success a 
student has in solving problems in an area to which the concepts are relevant. * 
It has been suggested that the relative level of concept attainment can be ' f 
Indexed by the relative difficulty of problems an individual learner can solve 
•in a given subject area (8). There is increasing evidence that the develop- 
ment of concepts or subsumers as Ausubel refers to functional concepts •, 
facilitates the acquisition of new, relevant information. Therefore, the 
acquisition of subsumers is important not only for transfer of learning to • 
new problem situations but also for facilitation of the acquisition of new 
knowledge. This is illustrated in figure 3. . In this figure we see that 
students who have been classed, as possessing high analytic ability, that is 
these students can do better than their classmates on tests of problem solving 
ability in botany, also show a marked increase in proficiency in acquiring 
new knowledge for a given interval of study time. This kind of data is highly 
supportive of Ausubel* s theory that the presence of highly differentiated 
subsumers in cognitive structure not only permits transfer to new problem 
situations but also substantially enhances the rate of new knowledge acquisition 
Much more research on these variable is needed. 

It was suggested above that time variable is an Important but often 
Ignored variable in learning research. Another form in which this variable 
should be analyzed is with respect to the efficiency of alternative instruc- 
tional sequences. The audio-tutorial modality provides an easy opportunity 
for trying two or more sequences for attainment of defined learning objectives. 
By monitoring student learning time when they are assigned to one or the other • 
of the learning sequences, and also by appraising their relative attainment 
at the end of the learning time, one has a -two way index of the efficiency 
of alternative sequences. Examination of these sequences may suggest where 
redundancy or the lack of organizers or the Inadequate development of necessary 
subsumers may have curtailed learning in one of the sequences. To be sure, 
an element of trial and error is Involved in this kind of exploratory research, 



but this is what is called for in good formative evaluation and this kind 
of research is very much needed in the study of education. 

Since students come to us with widely varying backgrounds, it is evident 
that they will have available to them a differing array of subsumers in 
cognitive structure*. The student who is particularly interested in chemistry 
may have highly differentiated subsumers in this area which will facilitate 
learning in certain areas of another science. Conversely, the student who 
lacks these subsumers or who has a highly differentiated cognitive structure 
in another area such as history or literature may find little facilitation for 
learning science but a substantial facilitation for learning in another field.. 
Therefore, it is less relevant to look at the factual information students 
have in a subject area as they enter a course but rather to attempt an 
assessment of the potential relevant subsumers they have for the discipline. 

The best method for this assessment is to present the students with micro- 
learning tasks and monitor the time required for them to attain given levels 
of achievement on these micro-learning tasks. This is, according to Ausubel's 
theory, one of the best indices for the availability of relevant subsumers 
and consequently, the best predictor of potential success in the course to 
be studied. Information from this type of pre-instructional analysis can be 
useful in:the improvement of instructional design as well as in the better 
assignment of students in multiple section courses. 

Relevant Research 

If one is willing to extrapolate substantially from research findings, 
the entire literature dealing with the use of various media in instruction., vary 
ing group size and pupil achievement, student and teacher variables related 
to pupil performance, and personality attributes and their relation to per- 
formance all indirectly suggest how science instruction can be effective. 

Our own survey of much of the science education literature showed very few 
studies based or. Ausubel's learning theory and it was necessary to extrapolate 
many of the findings or to guess at the methodology employed in the study to 
interpret the findings. The general picture obtained through this survey 
suggests that audio-tutorial approaches, being individualized in nature and 
employing a variety of media, should be more effective than traditional 
lecture-laboratory approaches for science teaching. Moreover, the important 
and powerful feedback arrangement that one has in an audio-tutorial center 
for identifying weaknesses in the instructional sequence permits a screening 
of instructional practices and a convergence toward more efficient in- 
structional sequences than could ever be obtained under traditional approaches. 
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Figure 1. Schema showing that knowledge bits which can be associated with 
an existing concept are accepted and "subsumed” to enlarge and strengthen 
this concept (meaningful learning.) Non subsumable knowledge bits are not 
accepted by the learner, or are learned independently (rote learning.) • 
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Figure 2. Schema showing that appropriate knowledge sequences can serve 
as "organizers” to facilitate subsequent meaningful learning. 
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The purpose of the sessions devoted to curriculum evaluation in science is 

« 

to familiarize participants with some of the evaluation strategies and methods 
of analysis currently being used in science curriculum projects. The approach 
we shall follow is the case study approach. Three evaluation programs , one each 
ajt the elementary* secondary*, and college level have been chosen to illustrate 
several of the recurring themes in the process of evaluation. The purpose of 
this paper is to define several elements of science curriculum evaluation and 
to offer some background information concerning each of the three projects. 

I. What is Curriculum Evaluation? 

There is a general lack of specificity regarding a definition of curriculum 
evaluation and its objectives. To provide a common ground for discussion* the 
following definitions are presented. 

Curriculum is here defined as a set of materials or planned experiences 
designed to accomplish certain stated or implied objectives. In science* 
curriculum has traditionally consisted of syllabi, courses of study, and text- 
books. Recently the science curriculum has been dominated by the alphabet 
programs sponsored by the federal government: PSSC, ESSP, SCIS, etc. 

A distinction should be made between curriculum and instructional method. 
Curriculum is the content that academicians, society, and teachers decide 



children should learn. Methods of instructions are the means by which this is 
accomplished. Curriculum is the "what" that is to be learned. Instruction is 
the "how." Within these definitions, it should be noted, in fact expected, 
chat there will be interaction between curriculum and instruction. Evaluation 
strategies should accomodate the possibility of this interaction. 

Evaluation is the gathering of information for the purpose of making 
decisions. Curricular decisions generally are made by funding agencies, 
developers, and eventual users of a program. Evaluation differs from basic 

f 

research in its orientation to a specific program rather than to variables 
common to many programs • The objective of educational research is to gain 
generalizable knowledge about the practice of education; evaluation seeks to 
provide a basis for making decisions aou,u*g alternatives . Evaluation is con- 
cerned with questions of utility that has identifiable components of 
description and Judgment . 

Curriculum evaluation serves two important functions; first, it provides 
a means of obtaining information that can be used to improve a curriculum, 
and secondly, it provides a basis for decisions about curriculum adoption and 
effective use. The fozmer is generally called formative evaluation, the 
latter is usually referred to as summative evaluation. The distinction between 
these two functions is in the manner in which the results are used. Are 
decisions made about a developing curriculum (formative) or is there need to 
reach decisions about a curriculum already completed (summative)? 

Another component of evaluation seems to hover in the minds of curriculum 
developers and funding agencies. It is not formalized in the sense of formative 
and summative evaluation, but it is something I would call "supportive" 
evaluation. It grows out of the needs of men to receive reinforcement for 



things they have done* Individuals who have written a curriculum program need 

approval for their efforts. Similarly, funding agencies need evidence that 

the dollars they have spent on a curriculum development project have rot been 

spent foolishly. The presence of this last kind of evaluation is often felt 
* • 

and at times tends to contaminate the other evaluation activities. Whether 
or not "supportive" evaluation evolves as a well defined goal will depend on 
the willingness of other curriculum evaluators and developers to recognize 
its existence* 

II. The Case Studies " 

In each case study a decision was made by the curriculum developers to 
include evaluation in their program. The nature and purpose* of the evaluation 
was mot clearly specified, yet there was a feeling among the authors that 
some kind of evaluation should be attempted. 

For the purposes of the training session, you are to suppose that you 
have been called in as an evaluation consultant to design and implement an 
evaluation program. A brief description of each curriculum is presented here 
for your information. None of the descriptions are very specific, but each 
typifies the usual starting point for curriculum evaluation. Most of the 
material was selected from statements of objectives written by the curriculum 
developers. Please read over each case study and formulate in your mind what 
you would suggest as an evaluation strategy. At the Research Training Program 

we will discuss some of the evaluation activities that actually were done and 

» 

provide an opportunity for questions and criticism. In this way, a better 
understanding of evaluation strategies and methods of analysis should be ob- 
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CASE A - TIIE CAMBRIDGE ELEMENTARY SCIENCE PROGRAM: An elementary 
science series developed by a comnercial publisher. 

Introduction 



The project' in which we are jointly participating is in many 
respects an educational adventure. While the development of an 
educational program is not new, the scope and organization of this 
project are unusual. To our knowledge, no science program other 
than those sponsored by agencies or foundations will have been 
given as rigorous and professional a trial as the Cambridge Science 
Education Program. 

The Cambridge .Science Education Program began as an idea some 
two years ago. The authorship was selected from the ranks of the 
leading educators, scientists, and science writers across the 
country. In the interim from then until now, the authors and the 
representatives of the publisher have endeavored to structure the 
most current and sound science program possible. 

The Program -- Point of View 

Ultimately, the Cambridge Science Education Program will be a 
complete science curriculum for grades kindergarten through nine. 

The field test will involve student text materials for grades one 
through eight . 

One of two approaches, at opposite ends of a continum, is 
generally ascribed to an elementary science program. One is 
"content" and the other is "process". Each approach has its dis- 
tinguishing characteristics, some of which are usually shared by 
the other. The Cambridge Program most accurately represents a 
blend of content and process, a wedding of the two points of view. 

As a meld, it gives due emphasis to essential content and to the 
processes of science which derive that and other content. There 
are few places in the program where either content or process is 
highlighted for its own sake. Rather, effort has been made to 
bring them together in a consonant and supportive manner. 

The designers of the Cambridge Program hold these goals as 
paramount : 

1. That the materials have scientific integrity; thac is, 
that they will represent what the scientific conmunity 
at large considers essential and nen-trivial science; 

2. * That the materials be flexible and feasible; that is, 

that they can be effectively used, understood, and 
enjoyed by teachers and students of varying interests 
and talents; 

Several steps have been taken to realize them. For example, five 
scientists are a part of. the project team. They fill the central role 
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of identifying for development those essentials of their individual dis- 
ciplines which direct us toward the goal of scientific integrity. 

Others, on the team represent the educational community and contribute 
to our realization of flexibility and feasibility. Three writers, of 
unparalleled stature, create the manuscript which is based on outlines 
from the scientists and on suggestions from the consultants and which, 
in its totality, comprises the basic program. An activities specialist 
prepares appropriate and integral investigations to strengthen the 
sianuscript. 

• 

There are other characteristics of the program which are apparent 
in its contents. They are as follows: 

1* The program Is carefully articulated, vertically as well as 
horizontally, so that there is continuity and sequence of 
development through the grade levels and a cohesiveness at any 
one .grade level. 

r , 

2* Attention is given to the acquisition of learnings in depth* 

3* The program gives emphases to the spirit of science, to the 
nature ot science and scientists, and to the relationship 
. of science to other forces and developments in our society. 

4*. Through word, illustration, and activity, it is pointed out 
and reinforced that science is a human endeavor, that 
science is not always as clear a line as it often appears, 
that uncertainties permeate science, that science is, at 
times, free -wheeling and open, and at all times, dynamic. 

5* Many opportunities are provided for children to investigate, . 
to think, to ponder, and to question. 

6* Finality and definiteness are not given the highest place. 
Indeed, there are times when ideas are presented as black- 
boxes where answers are not or cannot be provided. 

7* This science program is for children to learn and teachers 
to teach. If the material fails them for any reason - 
inappropriateness, difficulty, readability, or whatever - 
every effort will be made to rectify the problem. Our 
major hope is success - for the learner and for the teacher. 
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CASE B - HARVARD PROJECT PHYSICS; a secondary school level physics course. 

In 1965, this project decided to include research and evaluation as an 
integral part of its curriculum development. A considerable amount of material 
has been published concerning the evaluation of this program, however, the 
final results of the evaluation provide many examples of the variety of methods 
and techniques that can be utilized in curriculum evaluation. 

Attached as an appendix to this document are copies of a newsletter des- 
cribing the rationale and objectives of the course together with three reprints 
that explain the evaluation design that was chosen » For this curriculum 
project, we. will concentrate more on methods of analysis and results than on 
designing an evaluation strategy. 
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CASE £ - A college physical science course designed primarily- for non- 
science majors. 

The third case study which we shall examine has an additional component 
to those previously mentioned. It is a course that has already been 
completed and is in the hands of a comercial publisher. However, it was 
supported during development by a federal agency, and that agency has now 
agreed to support an evaluation of the program. Prior to attending the work 

' sessions it would be useful to read the description of the course and consider 

• * 

the model of evaluation you would suggest. Statements of objectives and 

• • » 

general rationale for the course are listed below. 

GOALS , 

One of the major goals of this course is to improve the students 

attitude toward science and to give them the feel of the scientist s 
approach. The project staff feels that neither of these goals is 
attained with a survey course which presents a wide range of factual 
material for the student to learn. The essence of science is not the 
learning of facts, but the asking of questions; not memorizing, but 
wondering; not being told, but trying to find out. Many of the students 
— - - c g course such as this are prospective elementary -school teachers* Our 
' f goal is to convince them that they will teach science best not by knowing 
all the answers, but by encouraging the children to wonder about the 
• world around them and perform their own experiments. 

With this attitude, teachers will look forward to the science 
period in anticipation of. cooperative exploration, not with anxiety 
about being unable to provide answers. The student under pressure 
to learn a large amount of subject matter hasn't time to wonder; 
to ask questions; to try to find out; to get into difficulty, as 
the practicing scientist does; nor to seek a better way of finding 
out. Yet without these time-consuming processes, a student cannot 
get the feel of science. To make time for the student to explore in 
this way, one must ruthlessly omit some areas of physical science that 
are commonly "covered*' in a survey course and focus on some topic that 
lends itself to simple experiments with familiar materials, preferably 
one that shows the intimate interlock of physics with chemistry. 

In this course the topic under study is the nature of solid 
matter - what it is like and how we find out about it. The text 
is called, significantly, AN APPROACH TO PHYSICAL SCIENCE. This is 
only one of *:fce many possible approaches; other approaches will be 
used, we hope, at some future time in other courses - courses also 
generated for the purpose of giving students the feel of doing 
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science. In a course with a focus, as opposed to a survey course, the 
topic in focus can be pursued in sufficient depth so that students 
gain confidence in results based on experiment, and thus see how we 

learn what we know. 

Another member of the staff defines the course objectives this 



way. 

We feel that the major objectives should be the evaluation 
of changes in students' attitude towards science as a result of 
this course experience, and that a secondary objective should be 
the evaluation of improvements in the students understanding of 
the processes of science and their ability to formulate questions 
and seek answers in the manner of a scientist. 

* 

The stated objectives of this course are listed below: 



Substantive . , . 

~ TT” To teach nonscience students how to go about studying 

natural phenoemena and how to formulate questions about 
physical situations. 

2. To teach nonscience students how to propose models and hypotheses 
to aid in understanding the behavior of matter and energy. 

3. To teach nonscience dtudents how to design simple, controlled 
experiments to test their hypotheses. 

4. To teach nonscience students how to analyze experimental 
results . 

5. To stimulate an awareness of problems of current interest 
to scientists s 

6. To provide for nonscience students a basis for recognizing the 
limitations of science. 

Attitudinal: _ . . 

1. To encourage the observation of natural phenomena, and to 

convey to nonscience students a sense of the beauty of the 
natural world* 

2. To demonstrate the power of logical analysis, and to persuade 
nonscience students that with effort, every intelligent in- 
dividual can learn to analyze events in a scientific manner. 

3. To develop in prospective teachers an appreciation for the use 
of simple, scientific apparatus to illustrate an idea. 

4. To generate in each nonscience student a confidence in his own 
ability to seek successfully answers to questions about the 
natural world . 
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I - A : 



II - A: 



II - B: 



II -Cs 



in - A? 
IV - As 
IV - Bs 



17 - Cs 



V - As 

V - Bs 

V -Cs 
VI « As 



VI - Bs 



VI - 



os 



VII - As 
VII - B: 



Construct a research investigation including the research hypotheses, 
operational definitions for the manipulated and responding variables, 
definition of the experimental unit, description of instrumentation, 
and procedures for execution* 

Construct an operational definition for the manipulated and responding 
variables named in a research hypothesis, given a research hypothesis 
or a research report. 

Construct an experimental design where the individual is the 
appropriate experimental unit. 

Describe the appropriate experimental unit for an investigation, given 
a witten description of the research. 

Identify the experimental unit used by the researcher in a study, 
given a written report. 

Distinguish' among nominative, denotative, connotative, and operational 
definitions, given a list of statements of definitions. 

Construct a research hypothesis for a written report of research, given 
the witten report without the stated research hypothesis. 

Identify a nd name the responding variable and the manipulated variable 
in a research hypothesis, given a statement of the hypothesis* 

Distinguish between examples and counterexamples of research hypotheses, 
given a list of statements. 

Construct revisions in a research design to reduce the likelihood of a 
threat po an investigation fbi* each threat identified by the learner*. 

«« - Wfcl 4. » 

Describe the data that could be provided in support of a responding 
variable measure, given a research hypothesis and/or a research design. 

Construct brief descriptions of research to illustrate each of the 
seven threats to the generalizability of conclusions. 

Construct revisions in a research design to reduce the likelihood of a 
threat (Campeil and Stanley list} in an investigation for each threat 
identified by the learner. 

Describe the data that could be collected and presented to support 
each needed assumption in a. research report, given a research report 
and a list of assumptions constructed by the learner. 

Identify and name threats to the generalizability of conclusions 
drawn in a research report. 

Construct brief descriptions of an investigation whr jh illustrate each 
threat (rival explanation), given a list of rival explanations advanced 
by Campeli and Stanley in their chapter in the Hardbook for Research 
on Teaching . 




Vix - C: Identify and name the assumptions acknowledged by the author of a 

research report, given the research report. 

VII - D: Identify and name the assumptions that need to be made to accept a 

researchers conclusions, given a research report. 

VIII - A: Identify threats to the validity of a research investigation's 

conclusion, given the description of an investigation and a list of 
rival explanations. 

VIII - B: Describe whether a research report distinguishes among findings, 

conclusions, and recommendations. 

VIII - C: Identify and name assumptions, given a simple argument. 

IX - A: Distinguish among findings, conclusions, and recommendations, given 

a list of statements. 

m 

IX - B: Identify and name findings, conclusions, and recoramendat ions , . given 

a research report. 
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Assessment Tasks: 

~ Definitions - 



" — 2 .^ Findings: Findings are observations taken in the process of 

carrying out research or statistical manipulations applied to 
observations*' For example, means, percentages, frequency 
distributions, correlations, results of statistical tests} 

• ' ' decisions to reject or not to reject null hypotheses are 

findings. 

2. Conclusions: Conclusions are value judgements related to the 

research hypotheses. After examining the research as a whole 

the design, the findings, the assumptions, and so on, the 

researcher concludes that either the research hypothesis for 
his study is supported or it is not supported. For every 
' hypothesis, there is one and only one conclusion. 

3*. Recommendations: Recomnendations are value judgements based on 

the conclusions of the research. They are usually related to 
(a) practice, (b) theory, or (c) future research. 

I. Label each of the following statements as findings (F), conclusions (C), 
recommendations (R), or none of the ■•'•hree (W). Use the definitions 
provided to assist you in making your decision. 

A. The mean of the experimental group is 37.3. 

B. • The hypothesis that the boys score higher than girls is 

supported by the data of this experiment. 

C. On the basis of this research, the school system should adopt 

• * the XYZ curriculum project materials. 

' ~ D. Boys scored higher than girls on the creativity test. 

* E. The data yield a correlation coefficient significant at the 

0.01 level. 

» 

F. There was no difference in achievement between the students who 
had modem chemistry and those who had traditional chemistry. 

* 

II. Read research report one. Identify the author^ (a) findings, (b) 
conclusions, and (c) recommendations. 

A. Findings: 



B. Conclu sions : 




C • Recommendat ions : 



III# To what extent did the author of research report one distinguish between 
the findings and the conclusions? 
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NARST Research Training Program Participants 
Dear Colleagues: 

On behalf of the executive board of NARST, I should 
like to express appreciation for your participation in 
the first NARST Research Training Program. New programs, 
like new courses, have a number of rough spots that need 
to be ironed out for maximum educational value. We 
recognize in somewhat more calm retrospect that there 
were substantial areas for improvement in the program. 

I am sure you share with us the belief that at least some 
of our objectives for the training program were fulfilled. 

Now that you can reflect upon your experience in 
the quiet of your study, I should very much appreciate 
a few minutes of your time to fill out the enclosed form. 

This form will be used as part of our summary report and 
will also be used by individuals concerned with the planning 
of future research training programs.. Since I am anxious 
to complete the summary report, your cooperation in returning 
the form promptly would be appreciated. 

Sincerely yours. 
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University of Maryland 
College Park, Maryland 20742 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. 



As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

1* identifying conceptual styles employed by pupils in learning 

2. observation of teacher-pupil interactions 

5# Classifying some learning structures of children and high school pupils 
4# identifying effects of teacher comments on child’s learning activity 
5# identifying teacher insensitivity and misconceptions of pupil conceptualizatii 
6* gained some specific know ledge and ideas about how to employ Piagetian 
clinical interview approach. for research purposes* 



4 




if / / 

2. The most valuable part of the program for me was: 

1* The experience of working with Jack Easley 
2* The presentation by Novak on organizers (vising Ausubel) 

5* The sharp contrast in views of Atkin and Walbesser which served to foous 
some of my own ideas* 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

I was in a work group where the leaders were too much like me in 
experience and knowledge* Furthermore they evidently had not been too 
well informed about their duties or had not prepared for the sessions* 

I got a few ideas but the session^mainly reinforced what I knew before* 
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4. Participants 1 would recommend for leadership roles in future training 
programs are: 

W e lch 
Walbesser 
Atkin 
Novak 

Bridgham (from Stanford- not leader at this 
Easley f . 

Maybe Winter or John Schaaf 



conference ) 



M L 
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Work Session Leade r Boeck & Pella 
Problem Session Leader (s) Easley 



Submitted 




Harold M. Anderson 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 
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x. As a result of the NARST Research Training Program, X gained^competence 0 
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in the following research skills : 
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2. The most valuable part of the program for me was: The work session dealing 

with unobtrusive measures of student-teacher behavior which can provide 
valuable information regarding how children think and the processes of teach- 
ing. The entire methodology seems to suggest a. much more realistic orientation 
to research to prescribe content for curriculum and methodology design than the 
"expert opinion" methods that we have used in the past. 

3. The least valuable part of the program was (provide reasons for your 

answer, if possible): The last two sessions of the problem group. I 

felt that these lacked value to me in that the problem sessions failed to ■ 
focus on a definable problem in these sessions. My hope in the earlier 
sessions was that this would occur in later sessions and thereby add a great 
deal of meaning to what we were discussing. Instead, however, we continued 
even in the later sessions to be very circular in the discussions so that at 
the conclusion of the group of sessions, no conclusions were reached. 

4. Participants I would recommend for leadership roles in future training 
programs are: 



Robert G. Bridgham 
William S. LaShier 



Work Session Leader 



Jack Easley 



Problem Session Leader (s) M° n tean 



and Steve Winter 




Submitted by: 
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Daniel S. Arnold 



SUMMARY REPORT 

KARST Research Training Program 
November 12-14, 1969 



1. Ac a result o 4- ' the NARST Research Training Program, I gained competence 
in the following research shills: 
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3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 
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4. Participants I would recommend for leadership roles in future training 
programs are : 
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NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 
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2. The most valuable part of the program for me was: 
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Participants X would recommend for leadership roles in future training 
programs are : 
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William C. -Berryman 
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SUMMARY REPORT 

KARST Research Training Program 
November 12-14, 1969 



1. As a result of the KARST Research Training Program, I gained competence 
in the following research skills: 
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The least valuable part of the program was (provida reasons for your 
answer, if possible) : 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

I gained greater competence in analyzing proposals and reports 
of research; in identifying, stating and/or evaluating 
hypotheses, limitations, problem and hypothesis statements, 
assumptions, fallacies in design, fallacies in procedures and 
fallacies in conclusions. 



2. The most valuable part of the program for me was: 

The most valuable part of the program was the opportunity to 
meet and talk to others interested in research; there was a 
great diversity in viewpoints. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

I resented the domination of parts of the sessions by persons 
doing "their own thing" — e. g., Watson's preoccupation with 
obtaining federal funding for research; Walbesser's narrow 
definition of research 



4. Participants I would recommend for leadership roles in future training 
programs are: 

Henry Walbesser 
J. Myron Atkin 

I did not have enough contact with others to recommend them. 



Work Session Leade rHenrv Walbesser 

Problem Session Leader (s) Fletcher Watson (Walbesser sat in) 



Submitted 



by : 
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Charlotte M. Boener 
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Joseph E. Bowles 



SUMMARY RKPORT 

NARST Research Training Program 
November 12-14, 1969 
• • 

1. As a result of the NARST Research Training Program, I gained competence 
in the following research stciils: 

The interpretation of student and teach behavior in instructional settings*: 
specifically the construction of "models" for beliefs from postural and 
linguistic cues. 

The testing of hypothesized models of beliefs by variations in the tasks set 
for instruction. 



2. The most valuable part of the program for me was: 

The work sessions. The opportunity to practice skills on "real" materials 
an d to discuss the contexts (research and practical) in which these skills 
might be useful was most helpful. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible) ' 

Th e problem sessions. Because the sessions lacked a clear focus and had no 
clear ties with any concrete problems they tended to generate "airy" argument 
and pontification. 



4. Participants I would recommend for leadership roles in future training 
programs are: 

Work sessions : Easley 

Problem sessions: Boeck 

Pella 



Work Session Leader 



Problem Session Leader (s) 



Submitted by: Robert G. Bridgham 



STANFORD UNIVERSITY 

STANFORD. CALIFORNIA 94303 



SCHOOL OF EDUCATION 



December 30, 19&9 



Dear Joe: 

I did some thinking about the research training sessions and would suggest 
three changes if we are to have a re-run. I thought the sessions were 
effective on occasions, but that too much time and energy were lost because 
of unfocussed, "what do they want" meandering. 

1. Deduce the number of senior men involved. Most seemed to be 

at "loose ends" through the work sessions and to be "protecting" 
prepared value positions in the problem sessions. 

2. Make the work sessions ninety per cent of the program and collapse 
the program to two full days. I*d suggest defining four or five 
problem- or skill-focused areas and designing a two-day program 
in each. The program for each area could be described in the 
prospectus for the overall program, and individuals would be asked 
to apply for the program in the area ( ) they thought mosu pertinent 
to their own research interests. They could also then be asked 

to justify their need for training in that particular area. This 
would reduce the "floundering" that characterized the first day 
of the training sessions and might cut out some individuals who 
"came along for the ride." 

3* Schedule the sessions imme diately before or after an appropriate 
convention and in the same locale. AERA -. HARST is already too 
long, but if the sessions were scheduled next to the.AAAS or 
NSTA conventions some participants might manage uo squeeze in 
an extra convention that they couldn’t have attended otherwise. 

Sincerely, 




1 



Application given to Kathio in Chicago* Do not have another form. 

SUMMARY REPORT 

NARST Research Training Program 
November 12-1'+, 1969 

1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

1) Understanding of general techniques- for programming CAI with respect 
to whole-course and part-course materials, including writing and 
evaluating global and- detailed behavioral objectives* 

2) Contrast of Ausubel and Piaget models of development and cognitive 
growth, and the research techniques apnropriate to within- and between- 
model testing. 

3) Extension of "inquiry skill" research to CAI and CMI models# 

2. The most valuable part of r j program for me was: 

1) Interaction on "inquiry techniques" with various others holding 
different definitions thereof* 

2) Off -session conversations about what research is going on in other 
places. 

3) New trends and research thrusts* 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible) : 

1) I felt the 15>Qmin. preswntations by the 6 presenters of Work Sessions 
were too brief to gain much, and should have come AFTER the choice of 

sessions# . 

2) Jfy work session was less valuable to me than my Problem session, but 

the work session was the main thrust item* 

4. Participants I would recommend for leadership roles in future training 
programs are : 

Dr* j e U. Gallagher, ERC* Cleveland < 

Ur. Tom Cleaver, BSCS, U of Colo, Boulder 



I WOULD LIKE TO RECOMMEND that at each of the L3 or so Sci Ed Centers 
some person be assigned to abstract for NARST annually and send to 
ERIC as a summary report entitled SCIENCE EDUCATION AT X UNIVERSITY 1969 
all master 1 a theses and doctoral dissertations (ca# 1000 words each) 
plus field studies, local studies, etc* AND 

that t hese be printed on microfiche by ERIC as a continuing service^ the 
Srssertations ultimately may appear in DISSERTATION ABSTRACTS, but the 
theses never do— —and sometimes these can be valuable* 

Work Session Leader Hansen 



Problem Session Leader (s) Buell 




Submitted by: 
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Robert R. Buell 



SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

a. The ability to look at assumptions programs of research through 
both historic and futuristic models of research design. 

b. The identification of specific research models with specific 
tasks rather than the fruitless search for one model to fit all tasks 
which can then be "molded" to fit the model. 



2. The most valuable part of the program for me was: 

The opportunity to share concerns, ideas, and the result in cognitive 
dissidence from the work sessions with Hike A4kin. This was most helpful 
and intellectually stimulating time. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

The problem session had a tendency to roam without clear focus. 



4. Participants I would recommend for leadership roles in future training 
programs are : 

Steve Leonard would certainly be a possible suggestion. 

(JU jH? 



Work Session Leader 



Adkin 



Problem Session Leader (s) 



Taylor 



Submitted 
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SUMMARY KKI’OKT 

NARST Research Trail*. in" Program 
November 12-14, 1969 

1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills : 

None. I chink this, however, a rather unrealistic goal in context with 
the way the program was organized. I should imagine it might have been 
better to identify some specific skills needed by participants and then 
to structure programs in such a way as to impart a gain in competence 
and to test the efficacy of that structure© 

2. The most valuable part of the program for me was: 

Contact and the sharing of ideas relative to specific problems v/ith 

research models, along with reviews and critiques of some research 
designs. I have also met and established lines of communication with 
people who are doing things that interest me 0 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

The problem sessions. . .simply because the function of the problem 
session was not carefully defined and it became — in some cases, though 
not mine— a forum for the interests and personal prejudices of the 
problem leader# In my specific case, it became a forum for discussion 
and identification of researchable problems in Science Education© 

4. Participants I would recommend for leadership roles in future training 
programs are : 

I have no specific recommendations to make based on this experience. 



Work Session Leader welch 



Problem Session Leader (s) jm Robert Buell 
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I consider the experience valuable and appreciate having Iqeejl 



Submitted by: ^ 




Thomas J. Cleaver 



SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 
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As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 
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!' ' , // 

' C ^ If, 









/ ?/ r/ r 






V/ 



, *■/. 



> 






/ / I j 

’ * "© ('Ctj’t* '** • 



The least valuable part of the program was (provide reasons for your 
answer, if possible): 
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Participants I would recommend for leadership roles in future training 
programs are: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1* As a result of the NARST Research Training Program, X gained ^competence 
in the following research skills: 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible} : 



4. Participants X would recommend for leadership roles in future training 
programs are: 
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2* The most valuable part of the program for me was: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

(a) Analysis of videotapes of small group interactions . 

(b) Analysis of videotapes of individual interviews. 

(c) Interpretation of data from interactions in small groups and in 
individual interviews . 

(d) Formulating research questions . 



2. The most valuable part of the program for me was: 

Work sessions on conceptual analysis of clinical interview and 
classroom situations . 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

Problem sessions on inquiry teaching largely due to the group leader's 
lack of any clear goal. 



4. Participants I would recommend for leadership roles in future training 
programs are: 

In general, the leadership roles in this program were filled with highly 
competent people. However, some of the more incisive and insightful 
younger men such as Bob Bridgham and Tom Cleaver might provide better 
leadership than some of the less capable "old guard." 



Work Session Leader Jack Easley 
\ * 

Problem Session Leader (s) Robert Buell 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

Techniques for curriculum evaluation which included .the following: 

a, familiarization with a random sampling technique for large populations 

b. instruments for measuring attitudes and processes of science (semantic 
differential concept) f also tests for physics achievements 

c 9 statistical techniques for handling semantic differential to identify 
clusters ; statistical analysis of pre and post test designs 

All are extremely relevant to me since I will be carrying out a 
research project next year similar in design to those by Welch. 

2. The most valuable part of the program for me was: 

Work sessions conducted by Wayne Welch and the gefneral address given 
by J. Myron Atkin. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

Problem sessions : No new ideas were developed. My impression was 
that it was a re-hash of what have been editorialized in the JUST for 
the past five years. One possible mechanism for eliminating this 
problem was suggested by our problem session, namely correlate the 
work sessions with the problem sessions so that there are some continuity 
threads working through the training program. 

wSI^run? 1 * however, I found the training program very valuable and 

4. Participants I would recommend for leadership roles in future training 
programs are: 

Gary Awkerman 

Notes It would be rather interesting to bring these peeple together 
to see if the program had any effect en them, to go in 
to more depth en the topics studied, and to develep ether cencepts 
relevant to research in scienoe education. 



Work Session Leader Wayne Welch 



Problem Session Leader (s) Stanley Helgeson 



Herbert Smith 




SUMMARY REPORT 
NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, 1 gained competence 
in the following research skills: 



1 
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2. The most valuable part of the program for me was: 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 
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4. Participants 1 would recommend for leadership roles in future training 
programs are: 
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Problem Session Leader (s ) 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. 



4. 



As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

&£«<jjfx«44%fev juf j aUyjJL AMfOjtAuAtM 

^ *Cui%L*u a*<*4a*Q*. /vduXtj — Hef- Ttu£u <k 

aJIuM . + 

The most valuable part of the program for me was: 

The least valuable part of the program was (provide reasons for your 
answer, if possible): 
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Participants I would recommend for leadership roles in future training 
programs are: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 



2. The most valuable part of the program for me was: 

4 — ^ -4i/^ 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 
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4. Participants I would recommend for leadership roles in future training 
programs are: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 

1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

i 

Understanding of Ausubel’s position with respect to learning 
psychology. 

How to apply Ausubel v s ideas to educational research. 

Knowledge about how certain of the association's members 

feel about the fruitlessness of certain types of research (methods studies). 
iow ledge of certain potentially fruitful areas of research in auto tutoria. 

2. The most valuable part of the program for me was: methods. 

The opportunity to have personal contact with both the 
leaders and the participants in the conference!. 

• ' 

The opportunity to examine the ideas of both leaders and 
the participants and to present my own in the small groups. 

perhaps these observations are both related to my relative newness in th< 

3. The least valuable part of the program was (provide reasons for your profession 

answer, if possible): 

i 

Perhaps the least valuable was the summary session — ; 

although it may not have been possible for it to be very 
much different. 9 I was left with with a concern as to 
whether or not we were going to get a rather complete 
transetipt k of the work of each group. 

4. Participants I would recommend for leadership roles in future training 
• programs are: 

j really do not have any recommendations here. It seemed to me that 
all of those present were rather effective. 



Work Session Leade r Ur. Joe Novak 
Problem Session Leader fe) Dr. Sam Postlewait 








Submitted by: 



Robert K/james 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 





1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

I ^learned how to design educational research based on the Ausubelian 
point of view. Also, I learned how to interpret reported educational 
research in terms of the Ausubelian point of view* 



2. The most valuable part of the program for me was: ! 

The Work Session, the general sessions and the informal discussions i 

between scheduled sessions* I 

j 

i 

} 

{ 

« 

t 

- i 
! 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

The problem session to which I was assigned never got away from discuss- 
ions relative to Ph.D. programs, placement, cost and problems faced 
by the larger universities* I had hopes that we would get around to j 

designing and planning for Regional 1 ' "*esda*ch training by* regional lab- 
oratories" and selected colleges, universities and public school systems* 



4. Participants I would recommend for leadership roles in future training 
programs are: 

On the basis of my observations, I think that an excellent slate of 
leaders were selected for the November 12-14 session* Also, I was 
particularly impressed by the following participants: 

(1) Dr* Richard M* Bingman . . 

Mid-Continent Regional Educational Lab* 

(2) Dr* Alan M. Voelker 

R & D - Curriculum and Instruction 
University of Wisconsin 



Work Session Leade r Dr* Joseph D* Novak 



Problem Session Leader (s) Dr* Fletcher Watson 

/ 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 
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2* The most valuable part of the program for me was : 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1959 
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1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

I developed an awareness of the prevailing attitude among science 
educators that the research community must establish its credibility 
with the school personnel expected to implement change. I came away 
from the conference with the conviction that our future research should, 
in part, concentrate on learner needs and priority needs expressed by 
teachers in the classroom. 



2. The most valuable part ->f the program for me was: 

The opportunity to discuss the problems that were relevant to a 
re-examination of the prevailing policy of science education research 
and specifically the problems of assessing teacher effectiveness in 
the classroom. 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

Our time was profitably spent in identifying the dimensions of 
problems related to specific research. There is a need, however, to 
bring such groups back together, after a lapse of 3 - 6 months to 
formulate and substantiate some concrete directions for finding answers 
to the questions that were initially formulated. The interval between 
meetings could be used by the participant to secure recommended micro- 
fiche studies, etc. and prepare individual position papers for informal dialogue 

4. Participants I would recommend for leadership roles in future training a t the 

programs are: second 



Attended 



Did Not Attend 



meeting 



David Butts 
Stan Helgason 



Mary Dudd Rowe 
Paul Westmeyer 



Julian Brandou 



Work Session Leader Myron Atkin 



Problem Session Leader (s) Steven Winter 



John Montean 




Submitted by: 



SUMMARY REPORT 

NARST Research Training Program 
November 12- 14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

The development or 

1. Techniques and strategies fcr curriculum evaluation and curricu 
lum research. 

2. Increased awareness cf variab3.es affecting research in science 
education. 



2. The most valuable part of the program for me was: 
The work sessions. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

Problem sessions 

m 

Our group, seemed to lack a sense of direction - although I realize 
that the determination of goals relative to research on teaching styles 
was one of our tasks. We had trouble focusing our discussion. 



4. Participants I would recommend for leadership roles in future training 
programs are: 

I was extremely pleased with Wayne Welch* s leadership. 



Work Session Leade r Dr. Wayne Welch 

Problem Session Leader (s) Dr. John Kontean 

Dr. Stephen Winter 

Submitted 




Donald W. McCurdy 
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NARST Research Training Program 
November 12-14, 1969 
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As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 
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4. Participants I would recommend for leadership roles in future training 
programs are: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

1. Identification of research questions, i.e. , investigating for potential 
sources of variance; 

2* Identification of research hypotheses, particularly through the use of 
changes in behavior; 

3* Writing of relevant research proposals (confidence at least i ) 



2. The most valuable part of the program for me was: 

By far the most valuable parts of the program were the problem sessions. 
The exchange of dialogue with Dr, H. Walbesser and others challanged my 
thinking and wanned my interests in behaioral research* 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

My inability to find an evening discussion group with whom 1 could 
continue dialogue. I suggest that some attempts at establishing 
voluntary groups on selected topics be included in subsequent con- 
ferences* 



4. Participants I would recommend for leadership roles in future training 
programs are: 

Dr. Henry Walbesser 

Dr. Richard Harbeck ( I learned a great deal over lunch from this n*misis 

ofU.S. O.E.) 

Dr. Herbert Smith 

and perhaps, other leaders from outside of Science Education who might 
be using techniques which we should apply. 



Work Session Leade r Dr. Herbert Smith and Dr. Stan Helgeson 
Problem Session Leader (s) Dr. Henry Walbesser 



Submitted 



by: 




Dr. Dale G. Merkle 
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1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

Use of computers in Science Education research. Strategies for Curriculum 
Evaluation . 

Designing research in Science Education of theoretical bases provided by 
Research in Learning Theory. 



2. The most valuable part of the program for me was: 

Problem Session: Over a two-three day period in a small company of 

interested individuals, much ground can be covered and critical concerns 
examined with suggested recommended procedures for new directions, 
good location. 

well- structured time allotment. 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible) : 

Lack of opportunity for analyses and confrontation with the main speakers 
a vis-a-vis basis - due to time. We tend to get on tangents of 
individual concerns which are distracting and time consuming in a short 
conference schedule. 



4. Participants I would recommend for leadership roles in future training 
programs are: Recommend that entire slate be re-united, on the basis 

of laving some experience, all could function more effectively. We are 
not doing as much as I'd like to see done with the applications of 
learning theory base. to science education research - perhaps more 
experienced learning theory people needed here. 

Work Session Leader: Duncan Hansen 



Work Session Leader Duncan Hansen 



Problem Session Leader (s) Steve Winter 



.John J. Montean 




John J. Montean 



SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 

1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 
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SUMMARY REPORT 

KARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

Curriculum Evaluation 

We are called upon to do course evaluations here, that is, 
various tracks of the same course. I got many useful 
ideas and procedures from attending Dr. Welch Is sessions. 

I learned more about the merits and limitations of the 
Flanders Interaction Analysis technique. 



2. The most valuable part of the program for me was: 
Curriculum Evaluation procedures. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

I could not find fault with anything. Some said they wished 
they had known before leaving home what some of the groups 
would be getting involved with so they could have brought 
certain materials along for use in the sessions. Maybe this 
would be helpful, though the complex problems of organizing 
a conference of this sort might preclude the possibility of 
doing more than was done. 

4. Participants I would recommend for leadership roles in future training 
programs are : 

Dr. David P. Butts — elementary science teaching 

Dr. Joseph S. Schmuckler — don't know his specialty 

n (I) r. William Kessen,-Yale University — Philosophy of science teaching 
Some of \ 

these probably Dr. Gerald Holton, Harvard University — Philosophy of Sci. Teaching 
t \ Dr. Bertram B. Masia, Univ. of Chicago =- The Affective Domain (?) 

to^AUST^buJ Dr * Wa y er » Director of BSCS, Boulder, Colo. Curriculum Development 

might be ’heir! ^ r * ^ orr ® nce i Univ. of Ginn:. — Creativity and Teaching the Gifted.* 

ful neverthe-^And someone to discuss problems of teaching science in the inner city- 
less. how to improve the self-concept iu the underprivileged) 

I thought that Dr. Atkin's presentation in the general session was excellent. 

Dr. Wayne Welch 



Work Session Leader 



Problem Session Leader (s) Dr. John Montean 

Dr. Stephen Winter 



*Dr. E. Paul Torrance is Chairman «nd Prof. 
Educational Psychology, Univ. of Georgia, 
Athens , Ga. 30601 . 
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Clarence H. Nelson 
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1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

2 . OA cyt/ufl^ 7 2? Auui^iX a— ^ 



The most valuable part of the program for me was: 
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3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 
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For a first time progra^^h^,^ it was pretty good and I am 
nappy I was able to atiHaoT 

NARST Research Training Program 

November 12-14, 1969 



1. As s result of the NARST Research Training Program, I gained competence 
in the following research skills: 

Situation analysis-Use of recorded classroom sequences in 

finding teaching difficulties. 



2. The most valuable part of the program for me was: 

Discussion with other people having problems similiar to those 
I am having. Opportunities to compare opinions relative to 
research procedures being employed. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

General session in which there was no connection between 
the address and research. It received the most time and 
was of the least value. In addition it was a repeat of the 
speech previously given. 



4. Participants I would recommend for leadership roles in future training 
programs are: 

I will recommend some topics that we should tackle. 

Sampling technics es. 

How to treat available data rather than the most desirable 
data. (Data that can be secured from willing schools or 
populations rather than random samples.) 

Development of instruments-Achievement-inventories- 
atti tude-interes t- Special interest should be directed 
to data treatment. 

Research design that makes it possible to use a local 
school population and come out with meaning. 

Work Session Leade r t?p oi Ay 

Problem Session Leader(s) Pell a 



Submitted 




Milton 0. Pella 



• SUMMARY REPORT 
NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

Identification and clear definition of specific and 
important research problems. 



2* The most valuable part of the program for me was: 

The study conducted by Joe Novak on Thursday afternoon. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

Each part of the program in which I participated was very 
much worthwhile. 



4. Participants I would recommend for leadership roles in future training 
programs are : 

Gerald Meyers, University of South Dakota; Joseph D. Novak, 
Cornell University 



Work Session Leader fJo 1 

Problem Session Leader (s) LL t • '<± \ / 



Submitted 




Samuel Postlethwait 



SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1, As a result of the NARST Research Training Program, I gained competence 
in the following research skills : „ y f) • D < 0 
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3. The le ast valuable part of the program was (provide reasons for your 
answer , if possible) : 
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4. Participants I would r^ommend for leadership roles in future training 
programs are: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: t oid taps as many sessions 

as possible and may have a reference to some test or statistical treatment 
that I didn*t have prior to the program. 



2. The most valuable part of the program for me was: The work sessions 
with you (Novak) and our work with Ausubel*s work. It has caused me to 
go back and take a second look at Piaget f s work in relation to the tnings 
that were said in our sessions. The interchange in that session was 
good also. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): The 1st day*s problem session. It became a 

power struggle between Walbesser and another participant as to who was 
the sharpest. It did not stick to the subject and the leader could not 
direct -it in any other direction. 



4. Participants X would recommend for leadership roles in future training 
programs are: Donald J. Schmidt and Jacob Blankensmp 

Note: I think there will more latent benifits because of the tapes 
and articles that I acquired at the program. A possibility for future 
sessions would be to discuss a research proposal, design, andtopic 
at greater depth. Also a brain storming session of possible research 
topics would be benificial. Things that need to be researched at 
greater depth and things that need initial research done on them. 



Thanks for including me. I hope I made some contribution to the group. 



Work Session Leader Novak 



Problem Session Leader (s) Clarence bocck 

Hilton 0. Pella 
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SUMMARY KKl'ORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills : 

a. I became quite well informed about the use of KiIC publications anu how 
they can be utilized by myself and my students in the stuoy of related 
literature for research work. 



o. 



I was introduced to a specific theory cf learning ana became well enough 
acquainted with the theory to apply it to research assign and analysis. I 
had practice in conversing within the " framework : of the theory ana also 
had practice in analysis of research in terms of this learning theory. 1^ 
also* was stimulated to start making preliminary research designs using this theory I 

2. The most valuable part of the program for me was: 



a. The intimate contact with persons who were sincerely "sold ,: on research ideas 
and the oppoortunity to work at length and in depth with one of these people. 

b. The informal contact of others with similar interests ana the ability to find 

out what is going on around the nation in Science education research. 

3. The least valuable part of the program was (provide reasons for your 

answer, if possible): 



CL* 



The times I became " trapped" by some person who thought he knew everything 
and had all the answers to everyone s problems. Certain of the 11 older 
Science Educators simply love to hear themselves talki Sad but true l 

b. The summary sessions were weak. Each group must take more responsibility in 
making a meaningful final report. 

4. Participants I would recommend for leadership roles in future training 
programs are: 

Seek out people >’ho have ' something going", those -who have a main thrust 
of research and study. Such as Henry V/albesser, V/ayne Welch, Joe Novak, etc. 
Try to avoid those who try to be "jack of all trades" but in reality are masters 
of none. Others who are shaping research around specific psychological theories 
would be great. Example: Dr. Darrell Philips (Pigaetian psychology) 



Work Session Leade r ^ • Josepn Novak 
Problem Session Leader (s) Herbert Smith 



Submitted 





Donald J. Schmidt 



SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 
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3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 
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4. Participants I would recommend for leadership roles in future training 
programs are: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills : 

Design, communication, and direction of research programs 
were the main areas of competence enhancement gained by 
participation in the research training program. 



The most valuable part of the program for me was: 

The planned interchange of idea s w ith colleguee . 

The program structure allowed for direction in this 

exchange as well as providing an opportunity for "chance 

events" to contribute to the constructs of the topic. 

There was an. aaole^amount^of direction without the oft. . 
encountered iruiibitir.g directs of authoritative supervision. 
The least valuable part ot the program was Tprovide reasons 'tor your 

answer, if possible): ... . , 

There was not a least valuable aspect in the program as 

such. The least exploited were a number of the participants. 

Only Dr. Atkin was provided an opportunity to address the 

group with any duration. I would like to have seen a 

number of the other session leaders given the same 

opportunity. Their remarks certainly would have contributed 

to the program. 

Participants I would recommend for leadership roles in future training 
programs are: 



Dr . B . Ingman 
University of New Mexico 
Albuquerque, New Mexico 



Work Session Leade r J « Myron Atkin 

Problem Session Leader (s) Fletcher Watson 




Submitted 



by: 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

• 1. Evaluation of strategies for assessing the proposed research training 
program in our institution. 

2. Strategies for analysing research studies and judging their weaknesses 
in light of recent developments. 



2. The most valuable part of the program for me was: 

Opportunity to participate in activity under supervision of experienced 
person. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 

Introductions to sessions - the overviews presented in these sessions 
could have been provided in writing prior to the session - they appeared 
to -be "sales pitches" or "group psycho-therapy" sessions. 



4. 



Participants I would recommend for leadership roles in future training 
programs are: 



Wort: Session Leade r VJalbesser 
Problem Session Leader (s ) Mat s on 



Submitted by: R.I,. Uffelman 



SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1S69 



1. As a result or the NARST Research Training Program, I gained competence 
in the following research skills : 

To me, the term competency is an inappropriate one for there were no 
objectives specified nor were there any measures of acquisition of skills. 
I do feel that I can now better (1) distinguish between problems and 
researchable problems and (2) identify concerns for programmatic research. 
Also, I acquired more awareness of the need to differentiate research 
responsibilities and to recognize that research training programs may not 
be compatible with the traditional graduate programs. 

2. The most valuable part of the program for me was: 

The opportunity to interact with peers individually and in small groups. 



3. The least valuable part of the program was (provide reasons for your 
answer, if possible) : 

Being in sessions with persons with wide and varied interests, and abilities 
made it difficult to concentrate on intended topics. (I derived some 
personal benefit from all sessions, but am not sure how much might be 
passed on to others in a direct manner.) 

4. Participants I would recommend for leadership roles in future training 
programs are: 



People who have a plan for running their sessions - free wheeling is a 
good technique for some groups, but not when you expect an opportunity to 
acquire competencies. 

I would be happy to conduct a session on learning research in the elemen- 
tary school, emphasis on the design of local programs. 



Work Session Leader J. Mvron Atkin 



Problem Session Leader (s) Fletcher Watson 



Submitted by: 




Alan M. Voelker 



SUMMARY KKl'ORT 



KARST Research 



November 



Training Program 

12 - 14 , 1969 



1 . 



As ? result of the NARST Research Training Program, I gained competence 
**.a the following research skills: 
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The most valuable part of the program for me was: 





3. The least valuable part of the program was (provide reasons for your 
answer, if possible): 




4. Participants I would recommend for leadership roles in future training 
programs are: 
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1. As a result of the NARST Research Training Program, I gained competence 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 



1. 



As a result of the NARST Research Training Program, I gained competence 
in the following research skills : 
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SUMMARY REPORT 

NARST Research Training Program 
November 12-14, 1969 

1. As a result of the NARST Research Training Program, I gained competence 
in the following research skills: 

New measurements in determining teacher *s characteristics 
Possible uses of CAI in research in learnind outcomes 
New models for science education research 



2. The most valuable part of the program for me was: 

Group presentations and the exchange of specific ideas and 
tools which was facilitated in the small group seminars. 

3. The least valuable part of the program was (provide reasons for your 
answer, if possible) : 

The attempt at presentation in the work sessions. The 
questions and the answers from the group leader (CAI) 
didn't always mesh. 



4. Participants I would recommend for leadership roles in future training 
programs are: 



Wayne Welch 
David Butts 
Addison Lee 



Robert Lepper 
Ernest Burkman 
Paul Kurd 



Work Session Leader: Duncan Hansen 







Work Session Leade r Duncan Hansen 

Problem Session Leader (s) Wayne Taylor 

Willard Jacobson 

Submitted by: 



Robert E. Yager 
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A RESEARCH TRAINING PROJECT IN SCIENCE EDUCATION 

Abstract 



The National Association for Research in Science Teaching, herein 
proposes that a research training project for researchers in science 
education be conducted during 1968. The first phase of the project will 
oe a session where resource persons will discuss preliminary versions of 
training plans and finalize arrangements for training sessions to be 
held ir* November, 1S6S. Fifty participants will be selected in September 
and October from among applicants indicating an active role and interest 
in the improvement of science education research. 

The research training project will be concentrated in three training 
sessions involving fifty trainees and resource personnel. The training 
sessions will have the specific objectives of training participants, (1) to 
distinguish between problems requiring traditional research design and 
newer evaluative designs, (2) to learn how to apply learning theory in 
rhe design of research, (3) to learn techniques and shills needed for 
science education research, and (4) to learn what hinds of research shows 
most promise for improving education. Evaluation of the participant's 
accomplishments will be an integral part of each training session, with 
leadership personnel providing examples and requiring evaluative comment 
on examples as well as trainee originated examples. The most productive 
training practices evidenced may be used as a basis for ,, 'presessiori M 

research training projects prior to future annual meetings of NARST and 
other groups. 
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A Research Training Project in Science Education 

Sponsored by the National Association dor Research in Science Teaching 

Supported by 

The U.S. Office of Education 



prrTjpnct? 

The national Association for Research in Science Teaching was 
founded in 1928 by a group of active workers in Science Education who 
recognised the need for exchange of ideas on research that could lead 
to the improvement of science teaching. The members of the Association, 
as veil as other education research 'workers , have contributed a substan- 
tial body of literature reporting on research studies of a variety of 
kinds directed toward obtaining evidence which could be used to modify 
instructional practice, teaching materials, or science curriculum organi- 
zation. Summaries of this research work have appeared as “Digests” pre- 
pared by the late Professor P.D. Curtis and more recent summaries have 
been published by the U.S. Office of Education. Though this research has 
contributed to our understanding of science teaching methodology and its 
affect or. learning, there is widespread feeling that much of the work is 



fragmentary 


and lacks sufiici 


eat cheoreti 


cai SC.SC 


to warrant 


oroad 


gen- 


eralizatior. 


from the research 


settings to 


science 


classrooms 


across 


the 


Nation. Since the membership 


Ox XS 


coraniutc 


d to uhe premise 


that 



instruction in science can be improved through the application of research 
evidence, it is appropriate for this organisation to sponsor a research 
training project. 

2'lany senior professors responsible for training science education 
personnel are not familiar with new research techniques. A primary 
objective of this project is to advance the research skills of these 
people engaged in training future research works . 

Ue have been through a decade of active educational curriculum 
innovation, most of v:hich has been based not on the findings of research 
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that has dealt with science education but rather on the intuitive feelings 
of experienced teachers and accomplished scientists. Though these efforts 
in curriculum development have done much to update the content of secon- 
dary and elementary science programs, the statistics on enrollments in 
subjects such as high school physics and surveys of public understanding 
of the scientific enterprise suggest that the new efforts still leave 
substantial room for improvement. The stage appears to be set for a new 
series of curriculum innovation efforts continuing the utilization .of 
talents from experienced teachers and capable scientists, but adding 
whatever research findings are relevant to the design and execution of 
future science programs. This appears to be an appropriate time to 
draw upon our fund of research evidence or. learning in science, and to 
identify critical areas,. and to acquire research competencies necessary 
for intensive study by teams of investigators to improve science instruction. 



Another objective of the proposed project is to provide examples 
of ways in which newer instructional technology can be used to improve 
research and teaching. Almost all of the new science curriculum programs 
have been dependent upon textbooks and laboratory guides used by teachers 
in much the same way as materials developed in earlier years and incor- 
porating to only a very limited extent the potential of currently available 
instructional technology. The role of the new teaching technology for 
improvement of science instruction is another area where further research 
is needed, and participants will learn to identify research problems dealing 
with evaluation of instructional technology.- 



GENERAL OBJECTIVE: 



To train science education researchers in newer 
techniques and research methodologies. 



SPECIFIC OBJECTIVES 

1. Participants will be able to distinguish between problems requiring 

traditional research design and newer evaluative designs. 

a. Given ten research problems, participants can specify an 
appropriate research design for at least nine. 

bm Participants will learn ways to restructure research 
questions to permit use of better research designs. 

2. Participants will learn how to apply learning , theory to the design 

of research. 



uc 






o 
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a. Participants will be able to state measurable parameters 

implied by a given learning theory for a specific research 
problem. 

b. Participants can indicate hov/ problems do or do not bear on 

a given i earning theory with success on at least four out 
of f ivo exanp 1 e s . 

c. Participants will be able to state at least three research 

problems that relate to a given learning theory. 

■. Participants mill learn tcchniouec and shills needed for science 



.'-•ciueatnon rascarcn. 
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b. Part icinants will learn sot- re 
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analysis and experimental design. 

Participants will learn he:/ to make decisions or. data nec- 
essary for answering specific research questions > wi th at 
least ninety per cent success. 

c ip ante will learn to specify how new technology can 
in research situations > and they will be able to 
provide examples for at least three out of four problems 
erven. 



*0 'v?'-: 



4. Participants will learn what kinds of research shows most promise 
for improving education. 

a. Participants will learn the limited value of surveys and 

status studies and be able to specify these limitations 
far at least four out of five examples. 

b. Participants will learn the limitations of "methods corn- 

par ison t! studies and be able to state the extent of 
potential generalizability for at least four out of five 



examples . 

Participants will learn haw 

^ ^ rr 



basic questions dealing with 
gait ivo development: can associate, teaching success with 
learning theory s specifying the relationship in at least 
four .out of five examples. 



.. bbmOhlL GUTCObKS 

1. x gw taj.ent viiij. .>e xcentx n^-ea j.caamg i»:LUiC :.esec.rou trein.Li.ig 

projects. 

2. The most successful elements of this project will serve as one mode 

for planning a research training program to be held prior to the 
1\A ilST annual meetings in February, 1969. 
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PROJECT PROCEDURES 



Step 1. It is intended that a planning session may be held in early 
Fall, 1968 at which time six to eight persons who would serve as re- 
source people for the conference sessions would meet together and discuss 
the kind of prepared papers and training exercises that they feel would 
be of most value for the research training sessions. It is planned that 
these key people will then return to their campuses and refine their plans 
for leading training sessions to be held in November. Final plans for 
the training sessions will be completed in September. 

Step 2. Fifty applicants will be selected for participation. In- 
formation regarding application procedure will be sent to members of NARST, 
and to selected journals for announcement. Race, creed, religion or 
geographic location will not be factors in selection. Priority will be 
given to applicants who are conducting or supervising research in science 
education. Professors in science departments who wish to gain education 
research competencies will be considered for participation. ’Applicants 
will be selected and notified by early October, 1968. A list of alternates 
will be established and selections from this list will be made as necessary. 

. Step 3. Final plans for the training sessions will be reviewed by 
the leaders on - Thursday evening, November 12. Last minute adjustments in 
training sessions will be made, if necessary. 

Step 4. Training sessions outlined for the project will be conducted 
November 13-15, 1968. In addition to a brief presentation by the session 
leaders, participants will engage in study exercises prepared by the 
leaders. For example, in the first session dealing with the use of learning 
theory in formulation of research hypothesis, participants will be given 
selected issues in science teaching and shown how to write research hypothesis 
bearing on these issues and consistent with elements of learning theory 
presented. Some exercises will be done individually and some in small 
groups. Evaluation leaders with guide discussion in the small groups, tapes 
of di. russions will be selectively transcribed immediately for use in 
subsequent discussion sessions. Individual and group reports will be 
typed and dupl ' t 1 for use by participants during the conference. Records 
of participc cesses and failures and other evaluation will be made. 
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Step 5. A report summarizing accomplishments of the project and 
recommendations for further action will be prepared by the Director. 
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TENTATIVE PROGRAM OUTLINE 



for a 

RESEARCH TRAINING PROJECT IN SCIENCE EDUCATION 

Chicago, Illinois, Nov amber Ufc-1^» 196Cj 

(This progra.l outlij^y?oul4/dflhiaodifIc*d by the planning conference pro- 
posed for June, l#b8 a^j#!ch leadership personnel v/ould discuss resource 
papers they w£4i prepare for Ncvijuber and correlated program activities.) 



Session I. Wednesday, November 1&, 196^, 9:00 A.M. 

Chairman: Willard Jacobson ^ 

Topic: Translating learning theory into research hypotheses in science 

education 

Speakers: m.ufv?jju_ b fre Carm fcaehft 

Hut wt ICRTOsmST" 

Joseph Novak*, • 

Herbert Smith ] Illustrations and applications 

mlyon Pella 
Stephen Winter ] 



TA-tA.St+L. , 




(Evaluation leaders) 



Session II. Wednesday, 2:00 P.M. - Continue session I. 



Session III. Thursday, November j£, 9:00 A.M. 

Chairman: Clarence Boeck 

Topic: Identification of techniques and skills needed by science 

education researchers. 

Speaker: Henry Walbesser* 

Robert Bihger ] • Illustrations and applications 
W. CL Van Deventer 
John Montean 
Jaires Rutledge ] 



n cccnniqucs ana skiixs ncuuea uy science 
Singer ] * Illustrations and applicatii 



(Evaluation leaders) 



Topic : 
Speaker: 






Experimental and Evaluative Designs: — . 

X ASmi . 

Robert Buell Illustrations and applications 

(Evaluation leaders) 

m-. 



William Cooley 
Clirence Nelson 
Twraas P. Fraser ] 




Session IV. Thursday, 2:00 P.M. 

Chairman": T. Wayne Taylor* 

Topic: Promising Research Directions in Science Education 

Speakers : 

William Cooley^ 

Jaiies Becker ) Illustrations and applications 

Pajl Blackwood , • . , , . 

(Evaluation leaders) 



Robert Howe 
ton Pella 



) 



>auc in the conference plann’ 



[eptember , 
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Session V. Friday, November 1^, 9:00 A.M. 

Chairman: Darrel Barnard 

Topic: Technology and science education research design 

1. CAI and research — Ducan Hansen* ^ 

2. Evaluation of learning aids — Wayne Welch* 

3. Audio-tutorial techniques and research — Samuel Postlethwait 
Evaluation sessions will follow each presenter. 



Session VI. Friday, 2:00 P.M. 

Chairman: James Robinson 

Final evaluation and summary sessions: 

1. Selection of research workers — Frederic Dutton 

2. Resources for research training — Richard Harbeck 

3. Changes /needed in university programs — Fletcher Watson 

4. Research design and data analysis — William Cooley 





*These individuals would participate in the conference planning session in Septembe 







i 

SKMufSiv ^SSmmL 1 !! 18 PAGE Is DUE TO POOR 
time* of" filming , better e available 




o 

ERLC 


1 







Budget Summary 



I. Trainee Support (50 trainees) 

Travel @$150. $ 7500 

Per diem 2 days x 50 @ $25 2500 

II. Institutional Allowance — none 

III. Direct Costs 

A. Personnel 

1. Program Director (J. D. Novak) 

Preparation prior to project sessions, 

preparation of final report 12 days @$100 1200 

2. Professional Staff: 

Leaders of project training session who 
will prepare papers: 

10 staff, 4 days each @$1000 4000 

3. Secretarial: 

Mailing announcements, processing applications, 
preparing training materials and suomary reports 



a. One secretary half time for 4 months 

@$200 per month 800 

b. Secretarial group for transcribing and 
duplicating group reports at the conference 

80 hours @$3.00 240 

B. Consumable supplies 

Paper, worksheets 100 

C. Travel 

Director and Professional, staff 20 round trips @$150 3000 

Per Diem 60 @$25 1500 

D. Other Direct Costs 

Printing program, mailing, phone 500 

Duplication and distribution of project reports 1000 

Total Direct Costs $22,340 

IV. Indirect Costs 

Use of KARST facilities and resources for project 

execution 8% of Direct Costs . 1»787.20 

Total Budget Request $24,127.20 
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imsossea of health, education and welfare 

Offico of Education 
Washington, D.C. 20202 



APPLICATION I-OR PARTICIPATION IN THE 
EDUCATIONAL RESEARCH TRAINING PROGRAM 



P©::« AppsfovcdT^557‘/ 
wooer bu;.:au i;o.- si 



USOE USE 0? 




(P.L. 63-531, Section 2 (b) , as 
emended by P.L. *89-10, Title IV) 



1, Title of program 

A research training project 
Education 



2 . 



in Science 




Program 

5/1/68 


period (from - to) 
11/15/68 


3. Amount 
v2A, 127 . 20 


Grant period (frocn - to) 
5/1/68 12/31/68 


5. Amount 
#4,127.20 

iL * 



6. Type of grant application 

[XI New application * [ ) Continuation of grant no. 

[ ) Revision of grant no. ( ] Supplement of grant no. 



7. Heme and address of applicant institution (street, city, state, zip code) ~ * 

National Association for Research in Science Teaching 

E-30 McPoncl llall, Michigan State Univ. , East Lansing, Michigan 488 23 

8. Subunits (give mailing address of last one listed) ' 



9* Type of applicant, "x w ono 

[ ] Higher education 
[ ) Educational agency 
' [ ) State [ ) Local [ ) Private 

(Xl Other: specify ‘ 

Professional Science Educat ion 
N on-profit Corpora t ion 



10. k Type of training program, "x M one 
. [ ) Undergraduate Training Program 

[ ) Graduate Training Program 
[ ) Postdoctoral Training Prograra 
( ) Institute 

[XI Special Training Project 
[ ) Program Development Grant 
( ) Other: specify ' 



11. Name and address of payee of grant award check 

National Association for Research in Science Teaching, E-30 McDonel llall, MiCuigaa 
StatJC-Undv^rvil^z^J K p st JLaiir.in g ^— M i chigan — 488.23. 



12. Nome and address of grant fiscal officer 
Dr. T. Wayne Taylor, Secretary-Treasurer, E-30 McDonel Hall, 

KiVMorn S &atfc Uni versi tv f 

CC CERTIFICATION 



13. Telephone 
355-1725 



I the undersigned on behalf of the applicant institution accept, as to any grant 
awarded, the obligation to comply with USOE Regulations and Guidelines for the Educa- 
tional-Research Training Program in effect at the time of the award. I further agree 
to comply with Title VI of the Civil Rights Act of 1964 (P.L. 88-352) , and the Regu- 
lations. issued thereto and state that the formally filed Assurance of Compliance with 
such Regulations (Form HSW-441) applies tc this project. I also certify that there 
are no commitments or obligations including those with respect to inventions incon- 
sistent with compliance with the above, and that trainees with such commitments will 



JlUb uy uucvpuljy AW All vug 

15. Name and title of program director 

(please type) 

• • 

Joseph D. Novak 


K VC.A CKUi m 

19. Race and title of offical signing for 
applicant institution (please type) 

Joseph D. Novak, President 


16. Address 
• 3 Stone Hall 

Cornell University 


17. Telephone 
607 

275-5410 


20. Address 

Stone Hall, Cornell U. , 
Ithaca, 14850 


21^ Telephone 
275-1410 


* 18. Signature 

% 


Date 
• • 


22. Signature • 

• 


Date 
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APPLICATION I-OR PARTICIPATION IN THE 
EDUCATIONAL RESEARCH TRAINING PROGRAM 

(P.L. 63-531, Section 2 (b), as 
amended by P.L. -69-10, Title IV) 


USOE USE ONLY 
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1. Title of program 

A research training project in Science 
Education 


2. Program period (from - to) 
5/1/68 11/15/68 


3. Amount 

&A r 127.20 

5. Amount 
*24,127.20 

i i * 


4. (hTUlt^j 


period (from - to) 
i 12/31/68 



6. Type of grant application 
[X! New application 
[ ] Revision of grant no.. 



C 3 Continuation of grant no., 
C 3 Supplement of grant no. 



7. Nome and address of applicant institution ( street > city, state, zip code) 

National Association for Research in Science leaching 

E-30 McDoncl llall, Michigan State Univ. t East Lansing, Michigan 436 23 

8. Subunits (give laalling address of last one listed) ' 



9. Type of applicant, w x M one 

( '3 Higher education 
( 3 Educational agency 
. 13 State [ 3 Local ( 3 Private 

(Xj Other: specify ' 

Professional Scj.ence Educat ion 
N on-profit; Corporation 



10. v Type of training program, "x" one 

( 3 Undergraduate Training Program 
( 3 Graduate Training Program 
C 3 Postdoctoral Training Program 
[ 3 Institute 

CXJ Special Training Project 
( 3 Program Development Grant 
( 3 Other: specify 



11. Nome and address of payee of grant award check 

National Association for Research in Science Teaching, E-30 McDoncl Hall, Michigan 

• A ^ A # A 4V A #1 * • . 





13. Telephone 


30 McDoncl llall. 


355-1725 





14 . CERTIFICATION 

I the undersigned on behalf of the applicant institution accept, as to any grant 
awarded, the obligation to comply with USCE Regulations and Guidelines for the Educa- 
tional -Research Training Program in effect at the time of tho award. I further agree 
to comply with Title VI of the Civil Rights Act of 1964 (P.L. 8S-352) , and the Regu- 
lations issued thereto and state that the formally filed Assurance of Compliance with 
such Regulations (Form HEW-441) applies to this project. I also certify that there 
are no commitments or obligations including those v/ith respect to inventions incon- 
sistent with compliance with the above, and that trainees v/ith such commitments will 



IlOl US 1UI MfU in Wio F- 

. 15. Name and title bf program director 
(please type) 

• • 

Joseph D. Novak 


19. Name end title of offical signing for 
applicant institution (please type) 

Joseph D. Novak, President 


16. Address 
• 3 Stone Hall 

‘ Cornell University 


17. Telephone 
607 

275-5410 


20. Address • 

Stone Hall, Cornell u. , 

Ithaca, 14850. 


21. Telephone 
275-5410 


18. Signature 

• 


Date 


22. Signature • 

• 


Date 


• 

• - . 
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• SUMMARY OF EDUCATIONAL RESEARCH 
TRAINING PROGRAM 
(P.L. 83-531, Section 2 (b), as 
amended by P.L. 89-10, Title IV) 


US0E USE ONLY 

m 


1. Title of program 
A research training project in 
Science Education 

1 


2. Program period (frosii - to) 
5/1/68 - 11/15/68 


3. Amount 

5. Amount 
g24.127.20 


4. Grant period (from - to) 
5/1/68 - 12/31/68 


6. Kamo and address of applicant institution (street, city .state, zip code) 

National Association for Research in Science Teaching, E-30 McDonel Hall, 

Michigan State University, East Lansing, Michigan 48823 - — 

* 7. Subunits (give mailing address of last one listed) 



8. Type of applicant 
Professional Science Education Non-prof:l 

XarporatJUm 



9. Type of training program 
: Special Training Project 



10. Number of trainees expected to participate 

A. Program period B. Grant period 

50 Grant supported students 50 Grant supported students 

Other students ‘ Other students 



• jLx# iv cy process xv iax i 

. Name 


Decree 


SJX M 1 UMUDGU 1 

Discipline 


ac.xuxHi; cuu _ 

Official title 


Department 


• 


m. • • < 


• 


* 


• 

« 

-# 

• 

* 



The purpose of this project is to train research workers and supervisors 
of research workers in science education in specific competencies necessary 
for improving the quality and quantity of research. Participants will learn 
to distinguish between problems requiring traditional research design and 
those requiring newer evaluative designs. They will learn how to write 
behavioral objectives for science instruction and techniques for evaluating 
the level mL attainment achieved toward these objectives. The participants 
will learn to appraise the relative contribution derived from surveys 
and status studies in contrast to the more basic and widely applicable 4 
findings resulting from research on factors affecting student s cognitive growth 
in selected areas of science. 

In addition, the project will identify additional talent to lead research 
training programs, serve as a model for- research training prcscssions prior 
to annual meetings of science educators', and accelerate the productivity of 
research workers in science education. - 
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DEPARTMENT OF HEALTH, EDUCATION AND WELFARE ] 
* Office of Education 
. Washington, D.C. 20202 

• 

. BIOGRAPHICAL SKETCH 

(P.L. 83-531, Section 2 (b), as 
amended by P.L. 89-10, Title IV) 


USOK USE ONLY 


• 


1. Name (last, first, initial) 
Novak, Joseph D. 


2# Position title 3.* Appointment date 

Professor-Corncll 6/1/67 •. 

• 


4. Education 

Institution (name and address) 


Degree/year . 
rect Ivod 


• 

Area of specialization ! 


University of Minnesota 
University of Minnesota 

• 


B.S. 1952 
Ph.D. 1958 


" ‘ T ' ' ' ' " 1 

Biology-Mathematics 
Science Education-Botany 


5» Professional work experience 
Employer (name and address) 


Dates 
From - to 


Highest 
position held 


University of Minnesota 
Kansas State Teachers College 
Purdue University 
Cornell University 


1956- 57 

1957- 59 / 

1959-67 
1967- 


Instructor of Botany 
Assistant Prof, of Biology 
Assoc. Prof, of Biology & Ed. 
Prof#’ of Science Education 



6. Research experience * 

1952-57 Research assistant - plant physiology 

1957-59 Research on lec cure- laboratory methods , instructional techniques 
1959-67 Research on cognitive growth; learning theory applications 



7. Major publications (not more then five) 

1. A experimental comparison of a conventional and a projected centered method of 

teaching a college general botany course# 

2. The role of concepts in science teaching 

3. An integrated experience approach to learning (book) 

8. Experience in developing and directing research* training programs 

Past President - Association of Midv/estern College Biology Teachers - led an 
evaluation training program for curriculum sponsored by CUEBS. 

Research training sessions at KARST meetings in 1962, 64, 66. 



9# Staff status 

tX3 Regular full time [ ) Others specify. 



10. Time allocation 




Percentage of time 






Teaching 


Administration 


Research 


Other 


Total 


A. Institution 


95 




• 






100£ 


B', Program 

a i « 


05 

• % « • • 


50 


• 


45 


05 





11. Program responsibilities . • 

Direct KARST training program including contacting key contributors and program 
planning ’ 



• •' 
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DEPAR1MENT OK HEALTH, EDUCATION AND WELFARE BUDGET BUREAU HO. 5| 

Office of Education 
. Washington, D.C. 20202 
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EDUCATIONAL RESEARCH TRAINING 
PROGRAM BUDGET 



(P.L. 83-531, Section 2 (t) , -as 
amended by P.L. 89-10, Title IV) 



USOE USE ONLY 






SUPPORT FOR GRANT PERIOD 



I. TRAINEE SUPPORT 



A. Stipend s 



1. Level 
and type 



Pr ofessional 



2. Sti- 
pend rate 



5. Subtotal: 



3. No. of 
trainees 



50 



Amount 






III. DIRECT COSTS 
A. Personnel 



1. Type 



Program director 



Prof, staff 



Other staff Secretaries 



2. Full- 
time 



3. Part- 
time 



10 



B. Consumable supplies 



5 . Subtotal; 



B. Dependency allowance 



1. Level 



Weekly 



Acad. yr. 



Full y r. 



2. Kate 



S 



400 

6oo 



5. Subtotal: 



3. No. of 
depend. 



C. Travel and relocation costs: 



D. 



Total trainee support: 



.Amount 



Amount 



JL£„Q0Q 



II. INSTITUTIONAL ALLOWANCE 



A. Based on rate per trainee 



1. Level 
and type 



2. Rate 



3. No. of 
trainees 



B . Total institutional allovance 






Amount 



l£l 



lapex., Worksheets 



Subtotal : 



C. Equipment 



Subtotal ! 



D. Travel 



Director and Prof. Staff 



20 round trips @ $150 



Per diem. 60 (3 $25 



Subtotal: 



E. Other direct costs 



Printing. Program, mailing phone 



Duplication, dist ribution of 



-pxgjcct reports. 



Subtotal : 



F. 



Total direct costs: 



4 . Amount 



$ 1200 



4000 



1040 



.62AQ. 



JJHL 



100 



3000 



1500 



4500 



m 






-15.00- 



£2112,340 — 



kame of ikst i tut i os- 
National Association for Research * in 






Budget allocation 


1st yr. 


2nd yr. 


3rd yr. 


4th yr. 


5th yr. 


Total 


. Trainee suopoi-t 


JLlmQO- 










8 


_1 nstituti onal allovance 




• 






• 




_ Direct costs 


12.340' 












Jtrdijie.ct costs ; _?2 


1.787. 


20 










' Total: 


$24,127. 


20 








8 - - 



i 



PROCRA fl TITLE 

A research training project in Science Education 



d 

i ' n ¥ i 



i 

I 



v?h p £§? jsss.-re •xps. 



TIME OFF ILMING 7 kfojl.S? 5 NOT AVA,LABLE AT THE 






Appendix 



G. Budget Summary 




Budget Summary 



Budgeted 

I • Trainee Support 

Travel and per diem $10,000. 

II. Institutional Allowance — none 
III. Direct Costs 



A. 


Personnel 






1. Program Director 


1200 




2. Professional Staff 


4000 




3. Secretarial Staff: half-time 


800 




Secretarial Staff: conference 


240 


B. 


Consumable supplies 


100 


C. 


Travel 

Staff travel and per diem 

/ 


4500 


D. 


Printing, mailing, duplication, 

and telephone 


1500 


Totals 




$22,340 


IV. Indirect Costs 

8% of Direct Costs 


1,787 


Totals 




$24,127 



Payments Made to NARST 
Less Expenditures 



Expended 

8750.58 



1200.00 

3600.00 

800.00 

158.74 

37.50 

1216.86 

1199.02 

$16,962.70 

1,357.02 

$18,319.72 

$21,715.00 

18,319.72 



Balance Due USOE 



$3,395.28 



